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It  ABSTRACT 


This  report  presents  a technique  for  choosing  cost-effective  instructional 
delivery  systems  for  proposed  training  programs.  It  is  the  Training  Effectiveness, 
Cost  Effectiveness  Prediction  (TECEP)  technique.  It  provides  an  orderly  approach 
for  the  skilled  training  system  designer  to  use  in  making  delivery  system  choices 
during  the  conceptual  design  phase. 

A three-step  procedure  is  described  in  which  training  objectives  are 
classified  and  organized  into  groups,  appropriate  learning  strategies  are  defined 
for  each  group,  media  capable  of  supporting  these  strategies  are  identified,  and 
the  costs  of  alternative  forms  of  training  are  projected.  With  nls  information, 
optimum  delivery  system  choices  can  be  made. 

Reference  materials  are  provided  to  aid  the  training  system  designer  in 
carrying  out  this  process.  Included  are  a list  of  12  types  of  learning  algorithms 
and  the  class  of  learning  objectives  each  supports,  separate  tables  for  choosing 
instructional  delivery  systems  for  each  algorithm,  and  a cost  model  for  comparing 
the  value  of  resources  required  by  alternative  delivery  systems.  A Fortran  IV 
program  listing  of  the  cost  model  is  included. 

A series  of  reports  describes  the  TECEP  technique.  In  addition  to  this 
report,  two  others  will  be  forthcoming.  They  are  TAEG  Report  No.  23,  Learning 
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SECTION  I 
INTRODUCTION 

The  selection  of  an  instructional  delivery  system  is  an  important 
step  in  the  training  system  design  process.  An  instructional  delivery 
system  is  made  up  of  the  student  and  all  of  the  elements  with  which  he 
interacts  to  achieve  instructional  go.?ls.  The  structure  of  this  delivery 
system  determines  in  a major  way  how  the  information  pertinent  to  training 
is  to  be  organized  and  presented  to  the  student.  The  choice  of  the 
delivery  system  affects  not  only  training  effectiveness  but  also  the 
costs  of  instruction.  For  example,  in  the  systems  engineering  approach, 
instructional  delivery  system  choices  are  determined  from  trade-off 
studies  which  consider  the  relevant  alternatives  for  training  and  the 
associated  costs.  Choo  ing  the  delivery  system  with  an  optimum  mix  of 
instructional  media  is  difficult  to  accomplish  in  an  intuitive,  informal 
manner.  A systematic  approach  to  media  and  instructional  delivery 
system  selection  is  required  which  is  formalized  in  the  training  system 
design  process. 

Recently,  the  Training  Analysis  and  Evaluation  Group  (TAEG)  examined 
the  available  formal  media  selection  techniques  for  possible  use  in  Navy 
training  system  design.  From  this  grouping,  the  10  most  promising 
published  techniques  were  selected  and  critically  examined.  None  of  the 
techniques  was  found  adequate  for  use  in  developing  specifications  for 
Navy  instructional  delivery  systems.  The  results  of  this  investigation 
are  presented  in  TAEG  Report  No.  8. 

The  available  formal  media  selection  techniques  suffer  various 
shortcomings.  All  tend  to  be  imprecise  (vague,  ambiguous  terminology) 
and  too  gross  in  categorizing  the  factors  that  influence  the  media 
selection  process.  They  also  lack  generality.  The  available  techniques 
are  tailored  to  specific  training  environments  and  are  inappropriate  to 
a range  of  training  situations  such  as  found  in  the  Navy.  To  be  workable, 
they  also  require  considerable  intuitive  judgments  on  the  part  of  the 
training  system  designer.  The  existing  approaches  are  incomplete  in 
that  they  do  not  account  for  all  the  critical  variables  in  the  media 
selection  process.  Prominent  factors  thrt  must  be  considered  include 
the  nature  of  the  tasks  and  task  structure,  the  learning  strategies 
appropriate  to  these  tasks,  the  media  types  available  for  instruction, 
and  the  procurement,  operati1"  and  updating  costs  of  alternative  media 
mixes.  Other  prominent  fac  s are  the  state  of  development  of  proposed 
media  approaches,  resources  required  for  courseware  development,  and  the 
characteristics  of  the  anticipated  student  population. 

1 Richard  Braby,  An  Evaluation  of  Ten  Techniques  for  Choosing  Instructional 
Media,  TAEG  Report  No.  8,  December  1973.  Training  Analysis  and  Evaluation 
Group,  Orlando,  Florida. 
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What  it  needed  are  means  for  reducing  the  weaknesses  inherent  in 
existing  media  selection  schemes  and  to  consider  ail  elements  of  the 
instructional  delivery  system.  The  selection  procedure  presented  in 
this  report,  called  the  Training  Effectiveness  and  Cost  Effectiveness 
Prediction  (TECEP)  technique,  is  an  attempt  in  this  direction. 

This  report  presents  an  operational  description  of  the  TECEP  tech-p 
nique.  The  ground  work  for  the  technique  was  laid  in  TAEG  Report  No.  1. 

In  its  present  form,  the  TECEP  procedure  has  incorporated  the  design 
requirements  for  an  optimum  media  selection  technique  articulated  in 
TAEG  Report  No.  8. 3 A one-year  field  trial  of  the  draft  version  of  this 
report  resulted  in  additional  refinements  which  have  been  incorporated 
into  this  final  report.  However,  the  technique  continues  to  possess 
some  of  the  worrisome  limitations  ascribed  to  the  previously  available 
techniques.  The  choosing  of  an  optimum  instructional  delivery  system 
for  various  types  of  military  training  objectives  remains  a subtle  and 
complex  decision-making  task;  something  that  cannot  be  fully  procedural- 
ized.  Training  system  designers  who  use  the  TECEP  technique  must  possess 
expert  knowledge  of  media.  The  technique  will  serve  as  a performance 
aid  in  carefully  exploring  the  probable  cost  and  effectiveness  of  various 
alternatives,  including  innovations. 

PURPOSE 

The  purpose  of  this  report  is  to  make  available  to  training  special- 
ists a procedure  for  choosing  instructional  delivery  systems  appropriate 
to  various  types  of  military  training.  The  TECEP  technique  serves  as  a 
performance  aid  for  the  training  specialist  to  use  in  defining  appropriate 
training  strategies  for  training  objectives,  choosing  instructional 
Ciliv°ry  systems  capable  of  carrying  out  the  training  strategies,  and 
identifying  the  relative  cost  of  these  alternatives.  Through  the  use  of 
this  procedure,  training  specialists  choose  the  cost-effective  instruc- 
tional delivery  system  over  its  competitors. 

ORGANIZATION  OF  THE  REPORT 

In  addition  to  section  I,  two  other  major  sections  are  presented. 
Section  II  provides  an  overview  of  the  TECEP  technique.  The  basic 
concepts  and  terms  employed  are  defined.  Section  III  provides  reference 

2 Staff  Study  on  Cost  and  Training  Effectiveness  of  Proposed  Training 
Systems , TAEG  Report  No,  1,  1972.  Training  Analysis  and  Evaluation 
Group,  Orlando,  Florida. 

3 Richard  Braby,  An  Evaluation  of  Ten  Techniques  for  Choosing  Instructional 
Media , TAEG  Report  No.  8,  December  1973.  Training  Analysis  and  Evaluation 
Group,  Orlando,  Florida. 
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materials  used  in  choosing  delivery  systems.  A formal  three-step 
selection  procedure  is  described  and  illustrated  through  the  use  of  a 
sample  problem. 

Supporting  information  is  presented  in  three  appendices.  Appendix 
A provides  an  alternate  method  for  step  2 in  the  TECEP  procedure,  the 
selection  of  candidate  instructional  delivery  systems.  A wider  range  of 
solutions  can  be  considered  using  the  alternate  procedure.  Appendix  B 
contains  an  analysis  of  the  equations  and  economic  theory  in  the  cost 
model,  arid  appendix  C provides  a Fortran  IV  program  listing  of  the  cost 
model . 


A series  of  three  reports  contains  the  information  needed  to  use 
the  TECEP  technique.  In  support  of  the  material  in  this  report  are  TAEG 
Report  No.  23, 4 which  provides  the  learnipg  models  used  in  selecting 
delivery  systems,  and  TAEG  Report  No.  24,°  which  provides  a detailed 
sample  application  of  this  technique. 


4 James  A.  Aagard  and  Richard  Eraby,  Learning  Guidelines  and  Algorithms 
for  Twelve  Types  of  Training  Objectives,  TAEG  Report  No.  23.  Training 
Analysis  and  Evaluation  Group,  Orlando,  Florida  (manuscript  form,  to 
be  published  mid-1975). 

5 Richard  Braby,  Choosing  Instructional  Del iyery  Systems  with  the  TECEP 
Technique  - A Case  Study,  TAEG  Report  No.  24.  Training  Analysis  and 
Evaluation  Iroup,  "Orlando,  Florida  (manuscript  form,  to  be  published 
mid-^). 
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SECTION  II 

OVERVIEW  OF  THE  TECEP  TECHNIQUE 

BACKGROUND 

The  TECEP  is  a technique  for  selecting  cost-effective  instructional 
delivery  systems  for  propot.ed  training  programs.  It  provides  an  orderly 
approach  to  making  delivery  system  choices  during  the  conceptual  design 
phase.  A sequence  of  steps  is  provided  for  identifying  generic  types  of 
delivery  systems  capable  of  accomplishing  designated  training  objectives 
and  for  determining  the  costs  of  owning  each  of  these  types  of  training 
systems. 

As  defined  in  section  I,  an  instructional  delivery  system  is  made 
up  of  the  student  and  all  of  the  elements  with  which  he  interacts  to 
achieve  the  instructional  goals.  Included  are  the  instructional  media, 
both  hardware  and  courseware,  the  instructor,  other  students  in  peer 
instruction,  and  the  direct  supporting  services  for  equipment  maintenance 
and  courseware  development.  While  media  may  be  a prominent  part  of  an 
instructional  delivery  system,  the  choice  of  a medium  includes  a package 
of  all  of  the  elements  in  the  instructional  delivery  system.  Therefore, 
the  availability  and  effectiveness  of  each  of  the  elements  in  the 
delivery  system  must  be  considered  in  making  a media  choice. 

The  TECEP  technique  requires  user  expertise.  It  is  not  a mechanical 
procedure.  It  requires  the  design  team  to  make  a series  of  key  decisions 
which  influence  significantly  the  resultant  media  mix  alternatives.  The 
TECEP  is  best  described  as  a job  aid  for  an  experienced  training  system 
designer.  What  it  provides  is  a pathway  and  procedures  for  systematic- 
ally coming  to  grips  with  critical  issues  in  planning  for  cost-effective 
instruction. 

Figure  1 shows  the  general  sequence  of  the  instructional  system 
design  process  and  identifies  the  chief  function  which  can  be  performed 
using  the  TECEP  technique. 
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The  process  of  selecting  instructional  delivery  systems  is  formally 
initiated  when  the  training  objectives  for  a proposed  training  system 
have  (,een  received.  A set  of  training  objectives  are  an  input  to  the 
TECEP  process.  Starting  with  this  set  of  objectives  a sequence  of  steps 
is  accomplished  for  deriving  appropriate  learning  strategies,  identifying 
instructional  delivery  systems  capable  of  supporting  these  strategies, 
and  determining  costs  associated  with  these  delivery  systems.  The 
output  of  this  effort  is  a description  of  an  optimum  instructional 
delivery  system  for  accomplishing  the  training  objectives.  The  TECEP 
process  flow  is  shown  in  figure  2.  Each  of  the  elements  in  this  process 
is  described  in  subsequent  paragraphs;  the  specific  materials  and  guide- 
lines for  their  use  are  provided  in  section  III  of  this  report. 
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Figure  1.  Training  System  Development  Model 


Flow  in  the  TECEP  Technique 
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CHOOSE  LEARNING  ALGORITHMS. FOR  TRAINING  OBJECTIVES.  An  algorithm  is  "a 
precise,  generally  comprehensible  prescription  for  carrying  out  a defined 
sequence  of  elementary  operations  In  order  to  solve  any  problem  belonging 
to  a certain  class. Therefore,  a learning  algorithm  is  a step-by-step 
prescription  for  a student  to  follow  in  learning  any  specific  task  in  a 
class  of  learning  tasks,  such  as  procedure  following  or  decision  making. 

It  is  a general  sequence  for  use  with  ail  similar  training  objectives. 
Learning  algorithms  have  been  prepared  for  the  more  commonly  experienced 
types  of  military  training  tasks.  Within  the  TECEP  approach,  each 
training  objective  is  matched  with  one  of  the  learning  algorithms. 

IDENTIFY  INSTRUCTIONAL  DELIVERY  SYSTEMS  FOR  EACH  SET  OF  SIMILAR  TRAINING 
OBJECTIVES.  A student  must  be  able  to  carry  out  each  of  the  steps  in 
the  algorithm  selected  for  a given  set  of  objectives.  An  instructional 
delivery  system  is  to  be  selected  that  enables  this  sequence  of  events 
to  take  place.  The  delivery  system  shall  be  capable  of  (1)  displaying 
the  essential  stimulus  characteristics  of  the  subject  matter;  i.e. , 
color,  motion,  sound;  (2)  allow  the  student  to  respond  appropriately; 
i.e.,  choose  an  answer  or  manipulate  a control;  and  (3)  provide  the 
student  with  the  required  form  of  feedback  and  reinforcement;  i.e.,  his 
scores  or  a dynamic  change  in  the  performance  of  the  system.  All  of 
these  events  are  specified  within  the  algorithms.  In  part,  the  TECEP 
technique  serves  as  a performance  aid  for  the  training  system  designer 
to  use  in  Identifying  all  those  delivery  systems  with  the  stimulus, 
response,  and  feedback  capabilities  required  to  carry  out  the  events  in 
the  selected  algorithm 

ESTIMATE  THE  COST  OF  ALTERNATIVE  SYSTEMS.  The  cost  of  using  an  instruc- 
tional delivery  system  is  the  total  value  of  all  resources  consumed  in 
that  part  of  the  training  program  supported  by  the  instructional  delivery 
system.  Included  are  the  costs  of  the  equipment,  the  curriculum  materials, 
the  personnel  (e.g.,  instructors  and  support  personnel),  the  supplies 
consumed,  the  facilities  supporting  the  use  of  the  system,  and  the  wages 
and  other  costs  of  the  student  who  learns  from  the  system.  These  costs 
can  be  estimated  with  the  aid  of  a formal  cost  model.  This  cost  model 
is  designed  to  display  the  cost  implications  of  substituting  one  medium 
for  another  in  a delivery  system  or  for  comparing  entirely  different 
Instructional  delivery  systems. 

CHOOSE  COST-EFFECTIVE  INSTRUCTIONAL  DELIVERY  SYSTEM  OR  MIX  OF  SYSTEMS. 

To  be  cost  effective  a delivery  system  must  (1)  facilitate  student 
learning  of  the  required  behavior  and  (2)  have  a relatively  low  use  cost 
when  compared  with  other  systems  also  able  to  support  the  required 
learning.  Using  the  TECEP  technique,  a training  system  design  team 
chooses  an  instructional  delivery  system  based  on  estimated  training 
effectiveness  and  cost.  Solutions  which  minimize  resource  consumption 
while  meeting  training  objectives  become  prime  candidates  for  incorpora- 
tion into  the  proposed  training  system. 


N.  Landa,  Algorithmization  ijn  Learning  and  Instruction,  Englewood 
Cliffs,  N.J.:  Educational  Technology  Publications,  1974,  p.  11. 
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REQUIRED  REFERENCE  MATERIALS 

Various  types  of  reference  materials  pertinent  to  the  TECEP  process 
flow  are  described  next.  They  serve  as  printed  job  aids  to  be  used  in 
carrying  out  each  of  the  steps  in  the  selection  of  a delivery  system. 
Figure  3 identifies  these  aids,  and  an  introductory  description  of  each 
item  is  presented  next.  The  actual  reference  materials  and  directions 
for  their  use  are  presented  in  section  III. 

TWELVE  TYPES  OF  LEARNING  ALGORITHMS  WITH  THE  CHARACTERISTICS  OF  TRAINING 
OBJECTIVES  THEY  SUPPORT.  Learning  algorithms  have  been  developed  for 
fundamentally  different  types  of  training  objectives  representing  military 
tasks.  They  are  based,  in  part,  on  the  Willis  and  Peterson7  list  of 
common  Navy  tasks  and  are  designed  so  that  (1)  a wide  range  of  tasks  can 
be  grouped  into  a small  number  of  categories,  (2)  all  the  training 
objectives  in  one  category  can  be  achieved  by  using  a single  learning 
algorithm,  and  (3)  each  category  of  training  objectives  requires  a 
different  learning  algorithm;  i.e.,  fundamentally  different  from  the 
training  strategies  required  by  other  classes  of  training  objectives. 

Only  the  names  of  the  learning  algorithms  and  the  characteristics 
of  the  training  objectives  they  support  are  included  in  this  volume. 

The  actual  algorithms  are  presented  in  a companion  volume.  Learning 
Guidelines  and  Algorithms  for  Twelve  Types  of  Training  Ob j ecti ves , T AEG 
Report  23,  to  be  published  mid- 1975. 

INSTRUCTIONAL  DELIVERY  SYSTEM  SELECTION  CHARTS.  A table  is  presented 
for  each  of  the  12  learning  algorithms.  Across  the  top  of  each  is  a 
comprehensive  list  of  instructional  delivery  systems  that  generally  can 
be  used  to  carry  out  the  steps  in  the  algorithm.  On  the  left  side  are 
listed  special  selection  criteria.  These  criteria  may  include  stimulus 
requirements  and  other  training  setting  and  administrative  criteria 
unique  to  specific  training  programs.  An  "X"  appears  in  those  cells  of 
the  table  where  the  instructional  delivery  system  meets  the  special 
cri  teria. 

By  entering  the  table  with  those  special  criteria  required  by  a 
training  program,  useful  alternative  delivery  system  approaches  can  be 
quickly  identified. 


7 M.  Paul  Willis  and  Richard  0.  Peterson,  Deriving  Training  Device 
Implications  from  Learning  Theory  Principles,  Vols,  I,  II,  and  III, 
Technical  Report : NAVTRADEVCEN  784-1 . July  1961.  U.S.  Naval  Training 

Device  Center,  Port  Washington,  NY. 


1 


I 
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TEST  OF  PRACTICALITY.  Eleven  criteria  required  for  practical  training 
system  proposals  are  listed.  Impractical  solutions  that  do  not  meet 
these  criteria  are  screened  out. 

COST  MODEL.  This  model  is  a series  of  mathematical  equations  representing  1 

the  cost  of  using  instructional  delivery  approaches  in  a training  system.  , 

It  Incorporates  a list  of  cost  factors  to  be  considered  and  a procedure  i 

for  combining  these  factors.  The  model  Includes  the  cost  of  acquiring  and 

operating  facilities  and  equipment,  the  cost  of  supplies,  the  cost  of  the 

design  of  instructional  materials,  the  cost  of  support  personnel,  and 

student  costs  associated  with  the  use  of  each  specific  instructional  ! 

delivery  system.  By  exercising  the  model  for  two  or  more  alternatives,  a \ 

comparison  can  be  made  of  the  costs  of  using  different  types  of  instruc-  « 

tional  delivery  systems.  The  cost  advantages  cr  disadvantages  of  each 

system  become  apparent  from  the  output  of  the  model.  The  model  has  been 

designed  to  be  responsive  to  the  requirements  for  economic  analysis  as 

specified  in  DoD  Directive  7041.3  and  SECNAVINST  7000. 14A. 

ADDITIONAL  SUPPORTING  DATA 

Figure  3 also  provides  additional  data  to  aid  the  user  in  the  practical 
application  of  the  TECEP  technique.  Each  type  of  data  Is  described  in 
subsequent  paragraphs.  The  actual  materials  are  located  in  the  appendixes  j 

of  this  report  and  also  in  the  companion  reports  mentioned  earlier. 

LEARNING  GUIDELINES  AND  ALGORITHMS.  The  learning  guidelines  and  algorithms 
described  below  are  presented  in  a separate  volume  (TAEG  Report  No.  23)  so  J 

that  training  system  designers  can  more  conveniently  use  these  aids  in  a £ 

variety  of  steps  in  the  instructional  system  development  process.  The  j 

separate  volume  can  be  used  in  choosing  instructional  events  during  the  ] 

planning  of  a curriculum  and  in  preparing  storyboards  and  scripts  during  , 

media  development,  as  well  as  in  selecting  delivery  systems.  j 

Learning  Guidelines.  These  guidelines  are  statements  which  prescribe 
specific  characteristics  to  be  built  into  the  design  of  a training 
system.  Guidelines  are  based  In  part  on  learning  theory  and  In  part  on 
practical  experience.  They  are  prepared  in  groups  to  describe  the  major 
characteristics  required  in  a training  system  to  accomplish  a given  type 
of  training  task.  Groups  of  learning  guidelines  have  been  developed  for 
the  12  types  of  training  objectives. 

Learning  Algorithms.  A learning  algorithm  has  been  prepared  to  represent 
each  ot  the  12  sets  of  learning  guidelines.  Each  describes  a sequence 
or  pattern  of  events  called  for  by  the  learning  guidelines.  Presented 
as  flow  diagrams,  they  indicate  the  data  processing  requirements  for 
carrying  out  the  intent  of  the  learning  guidelines. 


) 
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Application  of  TECEP  Technique.  The  guidelines  and  algorithms  are 
presented  as  tentative  statements  and  may  vary  in  usefulness  with  the 
complexity  of  the  training  problems.  While  the  sets  of  guidelines  and 
algorithms  display  less  than  proven  solutions  to  classes  of  training 
problems,  they  are  thought  to  represent  the  best  information  available 
today  for  prescribing  general  solutions. 

Accepting  or  rejecting  an  instructional  delivery  system  is  based  on 
the  criterion  of  whether  It  will  support  the  use  of  the  appropriate  set 
of  learning  guidelines  and  related  algorithm.  It  must  be  feasible  to 
carry  out  all  operations  of  the  algorithm  within  the  proposed  delivery 
system  for  the  system  to  be  identified  as  a useful  alternative.  While 
the  Instructional  Delivery  System  Selection  Charts  contain  alternatives 
that  meet  this  criterion,  the  designer  may  wish  to  perform  his  own 
analysis,  or  to  consider  a media-mix  not  presented  on  a chart.  The 
guidelines  and  algorithms,  therefore,  are  available  to  support  this 
function  if  he  chooses  to  use  them.  Familiarity  with  these  guidelines 
and  algorithms  is  essential  to  an  understanding  of  the  TECEP  technique. 

ALTERNATE  METHOD  FOR  CHOOSING  INSTRUCTIONAL  DELIVERY  SYSTEMS.  A method 
is  provided  for  the  designer  to  consider  delivery  systems  not  included 
in  the  formal  Instructional  Delivery  System  Solution  Charts.  With  this 
method,  generic  media  characteristics  required  to  implement  the  learning 
algorithms  are  stated,  and  media  containing  these  characterlsts  are 
Identified. 

To  support  the  designer  in  applying  this  method,  two  performance 
aids  are  provided.  The  first  is  a list  of  generic  media  characteristics. 
This  refers  to  fundamental  or  basic  capabilities  found  in  the  structure 
of  many  types  of  instructional  media.  Fifty-five  generic  media  character- 
istics have  been  identified.  The  list  includes  stimulus  characteristics 
such  as  "sound"  and  "color,"  trainee  response  modes  including  "multiple 
choice"  and  "tracking,"  and  performance  feedback  characteristics  that 
can  be  used  as  standard  media  descriptors  in  defining  existing  types  of 
instructional  media.  They  can  also  be  used  in  prescribing  the  general 
characteristics  required  of  a medium  fo.*  a proposed  instructional  delivery 
system,  thus  aiding  the  designer  in  choosing  types  of  media  that  contain 
all  the  required  characteristics. 

The  second  aid  is  called  a media  pool.  It  is  a list  of  89  general 
types  of  instructional  media  that  can  be  incorporated  into  instructional 
delivery  systems.  Each  is  defined  and  described.  Included  are  media  of 
various  levels  of  development:  operational  forms  of  instructional 
material  such  a programmed  texts  and  motion  pictures,  forms  under  develop- 
ment such  as  various  types  of  computer-assisted  instruction  and  computer 
simulation  games,  and  media  concepts  that  have  not  yet  reached  the 
prototype  or  pilot  project  stages  such  as  video  disc  and  microform  with 
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information  mapping.  The  list  Includes  a broad  range  of  media  types, 
from  printed  and  recorded  media  such  as  motion  pictures  and  broadcast 
television  to  three-dimensional  "hands-on"  media  such  as  mock-ups  and 
simulators. 

COST  MODEL:  DISCUSSION,  ASSUMPTIONS  AND  LIMITATIONS.  Background  data 

on  the  cost  model  including  economic  concepts  and  equations  that  make  up 
the  cost  model  are  presented,  and  all  terms  are  defined.  An  understand- 
ing of  these  economic  concepts  and  equations  will  aid  the  designer  in 
assigning  values  to  the  variables  In  the  cost  model  and  in  Interpreting 
the  output  of  the  model.  Limitations  of  the  model  are  described  to  aid 
the  analyst  In  avoiding  certain  pitfalls  in  Interpreting  the  cost  model 
output  data. 


o 

o 


FORTRAN  PROGRAM  OF  COST  MODEL.  Manual  use  of  the  cost  model  involving 
hand  calculation  is  a tedious  undertaking.  To  aid  training  system 
designers  in  the  use  of  the  cost  model,  a program  listing  of  a FORTRAN 
IV  program  of  the  cost  model  is  provided,  with  a sample  of  the  input 
data.  Instructions  for  the  use  of  the  program  are  included. 


o 

o 

o 
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POST  NOTE 

Potential  users  of  the  TECEP  technique  should  be  aware  of  limitations 
of  the  technique.  It  deals  with  highly  simplified  descriptions  of 
proposed  training  systems.  The  TECEP  technique  is  used  as  a performance 
aid  in  conducting  trade-off  studies  of  alternatives  prior  to  the  detailed 
development  of  any  one  of  the  alternatives.  Only  the  major  parameters 
of  these  systems  are  considered. 

In  addition,  certain  terms  used  in  the  equations  must  be  assigned 
estimated  values  due  to  the  absence  of  available  quantitative  data. 

Also,  subjective  interpretations  are  made  at  certain  key  points  in  the 
process.  Thus,  user  expertise  is  required. 


j \ The  technique  encourages  the  consideration  of  unorthodox  training 

V / solutions  in  that  a wide  range  of  alternative  media  are  examined  prior 

to  final  solution.  Therefore,  the  TECEP  technique  is  not  appropriate  in 
. ' design  situations  where  instructional  delivery  system  choices  are  con- 

\ j strained  or  where  operational  practices  or  policies  rule  out  many  pertinent 

forms  of  media. 

; \ The  learning  algorithms  in  the  technique  represent  training  approaches 

v ' for  most  of  the  important  types  of  Navy  training  tasks.  No  claim  is 

made  that  all  types  of  Navy  training  are  included.  There  will  be  instances 
where  a new  training  requirement  may  fall  outside  the  list  of  training 
- objective  classes  considered  in  this  technique,  or  where  it  might  be 

represented  only  by  a complex  mix  of  these  categories  and,  therefore,  be 
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difficult  to  align  with  a specific  learning  algorithm.  The  learning 
guidelines  and  algorithms  are  less  than  final  and  In  actual  use  must  be 
adjusted  to  accommodate  specific  situations.  The  media  classes  do  not 
discriminate  between  the  extensive  variations  that  exist  within  many  of 
the  classes.  In  certain  Instances,  t sfore,  following  the  detailed 
TECEP  procedures  will  not  be  productive,  but  the  use  of  the  media  list, 
the  cost  model,  and  other  parts  of  the  procedure  may  still  be  useful. 


The  procedure  and  the  guidelines  presented  in  section  III  must  be 
used  with  these  cautions  in  mind.  The  technique  is  not  inviolate,  and 
the  quality  of  the  output  will  be  dependent  on  the  expertise  of  the 
designers. 
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SEiCTION  III 
THE  TECEP  TECHNIQUE 

The  TECEP  technique  for  choosing  cost-effective  Instructional 
delivery  systems  can  be  used  as  a detailed  step-by-step  procedure  or  it 
can  be  used  generally,  in  a less  structured  manner,  as  background  informa- 
tion in  making  delivery  system  choices. 

The  technique  consists  of  three  steps  as  shown  in  table  1.  Each 
step  Is  described  In  detail  with  appropriate  guidelines  in  this  section. 
For  ease  of  usage,  each  step  is  presented  on  a separate  page,  followed 
by  art  example  of  the  step.  Reference  tables  (2  through  14)  required  to 
carry  out  these  steps  have  been  placed  in  the  back  of  this  section. 

Tabs  have  been  placed  on  each  of  the  frequently  used  references  to  aid 
the  designers  in  the  repeated  use  of  these  materials. 

TABLE  1.  STEPS  IN  THE  TECEP  TECHNIQUE 


GIVEN: 

Training  Objectives  for  a 
Course  of  Instruction 

Step  1 

Classify  and  group  training 
objectives  according  to  the  type 
of  learning  algorithm  required 
to  accomplish  the  objectives. 

Step  2 

For  each  group  of  objectives, 
identify  two  or  more  types  of 
instructional  delivery  systems 
that  will  support  the  use  of  the 
required  algorithm. 

Step  3 

Estimate  the  cost  of  using  each 
alternative  delivery  system  to 
train  the  required  number  of 
students  to  meet  the  objectives. 

Then: 

Choose  the  cost-effective 
instructional  delivery  system, 
or  mix  of  systems. 

•V 

■'i 
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Step  1 . Classify  and  group  training  objectives  according  to  the  type 
of  learning" al gori tFw.  required  to  accomplish  the  objectives.  The  initial 
step  Ts  to  match  each  trafnTng  objective  in  the'  proposed  training  system 
with  the  name  of  the  learning  algorithm  appropriate  for  achieving  the 
objective,,  The  names  of  12  learning  algorithms  and  the  characteristics 
of  training  objectives  that  can  be  accomplished  with  these  algorithms 
are  listed  in  table  2.  A tentative  classification  of  a training  objective 
is  accomplished  by  merely  matching  the  objective  with  the  name  of  one  of 
the  learning  algorithms.  This  classification  can  be  verified  by  comparing 
the  characteristics  of  the  training  objective  with  the  action  verbs, 
behavioral  attributes,  and  examples  of  objectives  that  can  be  achieved 
with  that  type  of  algorithm,  as  listed  in  table  2.  Use  only  the  predomi- 
nant or  critical  characteristics  of  the  training  objective  in  making 
this  determination.  If  two  or  more  algorithms  appear  to  be  required  for 
a training  objective,  consider  dividing  the  objective  into  two  or  more 
simpler  objectives  which  can  each  be  accomplished  with  a single  algorithm. 
Group  the  training  objectives  into  sets  that  are  classified  alike. 

The  reader  may  wish  to  review  TAEG  Report  No.  23®  for  background 
information  on  the  learning  algorithms  and  the  learning  guidelines  upon 
which  they  are  based. 

An  example  of  this  step  demonstrates  the  procedure: 

Training  Objective.  Given  (1)  an  operational  RF  signal  generator, 
Hewlett  Packard  6l4A,  (2)  the  characteristics  of  the  signal  to  be  generated, 
and  (3)  an  operator’s  checklist,  the  trainee  will  operate  the  equipment; 
i.o. , he  will  describe  and  then  perform  each  step  in  the  equipment  turn- 
on and  set-up  procedure,  proceeding  through  the  checklist  without  error. 

This  training  objective  has  been  matched  with  learning  algorithm 
Number  9,  Recalling  Procedures,  Positioning  Movement.  This  match,  is 
appropriate  in  that  the  "characteristics  of  the  training  objective  are 
similar  to  two  of  the  examples,  all  the  behavioral  attributes,  and  one 
of  the  action  verbs  listed  for  this  type  of  learning  algorithm,  as  shown 
by  the  checks  in  figure  4. 


8 

0.  A.  Aagard  and  R.  Braby,  Learning  Guidelines  and  Algorithms  for 
Twelve  Types  of  Training  Objectives,  TAEG  Report  No.  23.  Training 
Analysis  and  Evaluation  Group,  Orlando,  Florida  (manuscript  form,  to 
be  published  mid-1975). 
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NAMES  OF 
LEARNING 
ALGORITHMS 


9.  RECALLING 
PROCEDURES, 
POSITIONING) 
MOVEMENT 


CHARACTERISTICS  OF  TRAINING  OBJECTIVES  THAT  CAN  BE 
ACHIEVED  WITH  SPECIFIC  ALGORITHMS 


ACTION 

VERBS  BEHAVIORAL  ATTRIBUTES 


Activate  s/\  . Concerns  the  chaining  1. 
Adjust  or  sequencing  of  events. 

Align  Includes  both  the  cog- 

Assemble  nitive  and  motor  \,'2. 

Calibrate  aspects  of  equipment 

Disassemble  set-up  and  operating 

HJnspect  procedures. 

Operate  \/3.  Procedural  chec!'  lists 
Service 


arc  frequently  used 
as  job  aids. 


EXAMPLES 


Recalling  equipment 
assembly  and  dis- 
assembly procedures. 
Recalling  the  opera- 
tion and  check-out. 
procedures  for  a 
piece  of  equipment 
(cockpit  check  lists) . 
Fcllr'.n'or)  equipment 
turn-on  procedures  - 
emphasis  on  motor 
behavior. 


Figure  4.  Sample  of  Matching  Training  Objective  Characteristics 
with  a Type  of  Learning  Algorithm 
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RCCAUING  PROCEDURES  AND  POSITIONING  MOVEMENT 


To  chooii  a delivery 

1.  Place  a Cliohl 

pencil)  in  bo««* 

r«pr  «««nt  i r»i  criteria 
Iron)  that  auet  be  aet 

1.  MUU  the  delivery 
srsteaa  (coluana)  that 


dee igna* nd  by  * • 

Three  in  the  candidate 
l delivery  iflliei. 


Alternative  I 


Delivery  A #■  p r moht n 
PireittlRH  the  Appl  t i oh 

of  All  Learning  Guidelines 
and  Algorithm 


Criteria  for 
Selecting 
Ir st  rue t ional 
Delivery 

ir ■ tees 


Coup  lenity  Criteria 

•Difficult  Motor  Acte 


• Seooth  Motor  P»rfore*nc«  at 
End  of  Training 


Htliulue  criteria 
• Vliuil  rare 


Alpha -Nua»r Ic 


Hctor.il.  Plane 
Object . bo  i Id 


i Viaual  Novaaent 


Adainiitr.'t  i»*»  Criteria 

• Bit*  of  Courinvt  re  and  special  Hard- 
ware Dcvelopar.it 


# 1 ign i ( nd c of  Acquisition  Cost 
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Step  2 . For  each  group  of  objectives,  identify  two  or  more  types  of 
instructional  delivery  systems  wii'lch  wiTT  support~the  use  of  the  required 
algorithm.  Use  the  InstructionIT  Del i very  5ystem  Selection  Charts, 
tables  3 through  14,  to  perform  the  first  part  of  this  Step  in  the 
procedure.  First,  locate  the  cAort  representing  the  algorithm  selected 
in  Step  1.  The  chart  for  the  algorithm.  Recalling  Procedures  and  Position- 
ing Movement,  required  in  the  sample  problem  is  provided  as  figure  5. 

Note  that  the  col umns  headed  Alternative  Instructional  Del i very  Systems 
are  divided  Into  two  sections,  i.e.,  those  permitting  the  full  use  of 
the  algorithm  and  those  not  permitting  full  use.  The  latter  group 
includes  some  existing  or  traditional  practices  that  are  considered  to 
be  less  powerful  or  efficient  than  those  enabling  the  full  use  of  the 
algorithm.  The  designer  may  wish  to  add  additional  approaches  to  either 
side  of  the  chart. 


Along  the  left  side  of  the  chart  special  criteria  are  listed  for 
selecting  from  the  delivery  systems  presented  across  the  top  of  the 
chart.  While  3 large  number  of  criteria  had  to  be  satisfied  during  the 
development  of  the  chart,  only  those  unique  to  specific  applications 
need  be  considered  by  the  designer.  Those  criteria  presented  generally 
concern  the  stimulus  demands  of  the  subject  matter,  requirements  of  the 
training  setting,  and  certain  administrative  and  budgetary  constraints 
unique  to  the  specific  instructional  program. 

A blank  column,  with  the  heading  "Directions"  appears  on  the  chart 
immediately  to  the  right  of  the  criteria  list.  To  use  the  chart,  place 
a light  check  in  pencil  in  those  cells  designating  criteria  that  must  be 
satisfied  by  the  delivery  system.  Then  determine  which  delivery  systems 
meet  all  these  special  criteria. 

This  part  of  the  procedure  for  Step  2 has  been  carried  out  in 
figure  5.  Note  the  criteria  that  were  checked  as  being  essential  to  the 
training  program  for  this  objective.  Also  note  that  on!  the  circled 
delivery  systems  met  all  the  special  criteria.  Two  permit  the  full 
algorithm  to  be  used,  and  one  does  not  support  the  full  use  of  the 
algorithm.  The  two  tentatively  recommended  alternatives  are: 

1.  Operational  System  in  a Laboratory  with  Tutor 

2.  Microfiche  with  or  without  Photo  or  Operable  Mock-up. 
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Test  of  Practicality.  Each  candidate  delivery  system  should  be  critically 
evaluated  in  terms  of  the  following  criteria  to  insure  that  each  is  a 
practical  solution  to  the  training  problem.  Reject  those  alternatives 
that  are  impractical. 

1.  Marginal  Technical  Solutions  — The  learning  guidelines  and 
algorithm  cannot  be  easily  carried  out  with  the  system. 

2.  State-of-the-Art  --  The  system  is  under  development  or  test 
and  may  not  be  avail  able  for  practical  application  by  the  time  it  is 
required. 

3-  Size  of  System  --  Some  approaches  are  useful  within  large 
training  programs.  Others  are  suited  only  for  small  programs  and, 
therefore,  may  not  be  suited  to  the  size  program  being  considered. 

4.  Interface  with  Existing  Program  --  Many  new  courses  must  be 
designed  to  fit  into  existing  programs,  which  place  constraints  on  the 
new  courses;  e.g.,  equipment  on  hand,  available  classrooms,  scheduling 
practices. 


5.  Time  to  Produce  Systpi  — Approaches  which  require  long  lead 
times  for  development  may  not  be  useful  when  scheduled  ready-for-training 
dates  do  not  allow  a long  development  cycle. 

6.  Budget  Cycle  Constraints  --  While  the  application  of  some  of 
the  powerful  training  approaches,  such  as  CAI  (Computer  Assisted  Instruc- 
tion), may  result  in  low  costs  per  student  graduate,  the  initial  investment 
is  substantial.  Unless  these  resources  appear  in  existing  budgets,  the 
applications  of  these  techniques  to  an  immediate  problem  may  not  be 
feasible. 


7.  Adoption  of  Innovations  — Instructors  frequently  resist 
innovations.  If  the  proposed  technique  is  significantly  different  from 
existing  techniques,  either  adequate  resources  must  be  focused  upon 
gaining  acceptance  for  the  innovation,  or  a more  traditional  approach 
must  be  selected. 

8.  Courseware  Development  — If  the  courseware  is  to  be  locally 
developed,  skilled  personnel,  equipment,  time,  and  dollars  must  be  made 
available. 


9.  High  Cost  Alternatives  — The  projected  life  cycle  cost  of  a 
media  approach  may  be  significantly  higher  than  other  equally  useful 
alternatives.  Reject  high  cost  alternatives  when  others  are  available. 

10.  Learning  Style  of  Trainees  --  If  the  trainee  has  a low  reading 
ability  or  would  be  limited  in  his  ability  to  use  certain  kinds  of  systems 
then  reject  these  systems  as  inappropriate. 
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11.  Other  Constraints  — A variety  of  other  practical  factors 
should  be  considered;  e.g. , command  policy  and  existing  investment  in 
production  facilities. 

In  the  case  of  the  sample  problem,  the  approach  requiring  the  use 
of  operational  equipment  with  a tutor  is  found  to  be  a practical  solution. 

No  problems  were  identified  by  considering  each  criterion  in  the  practicality 
test.  During  consideration  of  the  microfiche-based  approach,  however,  a 
low  degree  of  risk  was  identified  for  two  Items.  The  first  low  risk  area 
concerned  test  item  Nianber  2,  the  "state-of-the-art."  Studies  involving 
the  use  of  color  microfiche  in  procedure-following  training  have  not 
been  conducted  within  the  Department  of  Defense.  However,  applications 
in  industry  have  been  successful.  Some  risk,  however,  is  associated 
with  the  initial  applications  of  colored  microfiche  in  the  military 
environment.  The  second  low  risk  area  concerned  test  item  Number  8, 
"courseware  development."  It  is  assumed  that  the  team  developing  the 
courseware  will  have  no  experience  in  developing  microfiche-based  courseware. 
This  lack  of  experience  is  not  considered  to  be  a serious  problem. 

Skills  required  would  be  similar  to  those  used  in  writing  programmed 
texts  and  making  slide  sets.  The  reproduction  of  the  color  microfiche 
would  be  accomplished  by  a commercial  laboratory. 

Both  instructional  delivery  systems  survived  the  practicality  test 
and  are  considered  to  be  candidates  for  use  in  the  proposed  training 
system. 

An  alternative  approach  to  Step  2 is  presented  in  appendix  A.  This 
approach  allows  the  training  system  design  team  to  consider  solutions 
not  contained  in  the  Instructional  Delivery  System  Selection  Charts.  It 
is  intended  for  use  by  those  with  an  expert  knowledge  of  media. 
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Step  3.  Estimate  the  cost  of  using  each  alternative  del i very  system 
to  train  the  required  number  of  students  to  meet  the  objectives.  Use 
the  Cost  Data  Collection  Form,  i ncludecT as  Attachment  1" at  the  end  of 
this  report,  to  record  the  data  necessary  to  run  the  cost  model  for  a 
single  alternative.  Repeat  this  process  for  each  of  the  alternative 
instructional  delivery  systems.  Figure  6 presents  the  cost  data  in  the 
two  instructional  delivery  systems  in  the  sample  problem.  The  values 
assigned  to  each  of  the  input  variables  are  dictated  by  the  problem 
under  analysis.  It  is,  therefore,  the  responsibility  of  the  training 
specialist  to  develop  these  values  for  his  problem.  Much  of  the  necessary 
data  can  be  developed  from  historical  information,  manuals,  and  other 
secondary  sources.  Where  no  empirical  data  exists,  it  may  be  necessary 
to  make  estimates  for  selected  variables.  These  data  must  be  in  accordance 
with  the  definitions  shown  in  appendix  B and  coded  in  the  format  specified 
in  appendix  C.  The  coded  data  along  with  the  working  computer  program 
in  Fortran  IV  in  appendix  C can  be  delivered  to  almost  any  data  processing 
group  for  processing.  Although  the  computations  can  be  performed  on  a 
hand  calculator,  this  is  a time-consuming  process.  Most  tasks  require 
numerous  runs  of  the  program  which  would  require  an  unacceptable  number 
of  man-hours  for  manual  computation. 

The  output  of  this  procedure  is  a numerical  value  for  31  factors 
which  describe  various  aspects  of  the  cost  of  using  a training  system. 

One  output  of  the  model  is  the  "present  cost"  of  each  alternative  instruc- 
tional delivery  system.  The  "present  cost"  represents  the  amount  of 
money  that  would  be  necessary  at  the  beginning  of  the  project  to  implement 
and  operate  the  project  over  the  entire  planned  life  of  the  system.  The 
amount  of  money  held  for  use  during  the  second  and  subsequent  years  is 
credited  with  interest  at  a specified  rate.  The  costs  for  each  year  in 
the  planning  period  are  discounted  to  reflect  this  time  value  of  money 
and  these  discounted  costs  are  summed  to  obtain  the  "present  cost"  of 
the  alternative.  The  justification  for  discounting  evolves  from  the 
concept  that  expenditures  which  are  postponed  to  future  years  cost  less 
in  terms  of  today's  dollars  than  tomorrow's  dollars.  With  this  type  of 
cost  information,  alternative  training  systems  can  be  compared  and  the 
systems  ranked  in  terms  of  their  cost.  The  cost  advantages  or  disadvantages 
inherent  in  choosing  one  system  over  another  become  apparent. 

Cost  summary  data  for  the  sample  problem  generated  through  the  use 
of  the  cost  model  are  contained  in  figure  7.  Data  for  the  two  candidate 
systems  are  presented  next  to  each  other  so  that  comparisons  can  be 
easily  made.  Intermediate  output  data  on  each  of  these  alternatives  are 
presented  in  appendix  C.  Cost  analysis  ends  when  system  costs  have  been 
projected  for  each  of  the  proposed  alternative  training  systems. 
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Instructional  Delivery  System  Operational  System  in  a Laboratory  With  Tutor 
Run  ID  Example  1 


FORTRAN  Symbol 

Variable  Description 

VALUE 

Units 

:ac1 Titles 

FflCOsY 

Total  facilities  acquisition 
and/or  refurbishlnq  costs 

O 

Dollars 

LOFFA 

Expected  years  of  life  of 
FACOST  assets  fin  whole  numbers) 

o 

Years 

sOFTTn 

Total  square  feet  required 
for  each  instructor 

Sq  ft 

SQFTST 

total  square  feet  required 
per  student  position 

iS 

Sq  ft 

SQFTAM 

Total  square  feet  required 
for  administrative  overhead 
for  all  student  positions 

1&P  . 

Sq  ft 

Equipment 

EQCISP 

Equip,  implementation  costs 
independent  of  stud,  pos. 

/) 

Dollars 

LO’FEQl 

Expected  years  of  life  of 
EQCISP  assets  (in  whole  numbers) 

/> 

Years 

EQIMPC 

Equip,  implementation  costs 
per  student  position 

3&zro 

Dollars 

U5FHT- 

Expected  years  of  life  of 
EQIMPC  assets 

iO 

Years 

TSPOSD 

Percent  of  operating  time 
student  position  down 

Percent 

Figure  6.  Sample  Cost  Data  on  Cost  Data  Collection  Form 
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FORTRAN  Symbol 

Variable  Description 

Value 

Units 

Instructional  Ma 

terial  (IM) 

I,  CM) 

Percent 

TJTRD 

% of  TLENGH  (i.e.,  time  spent 
In  training  medium)  for  which 
new  Instructional  material 
must  be  developed 

mbu 

% of  original  development  cost 
required  each  year  to  maintain 
instructional  material 

A,  AO 

Percent 

EVTH 

i of  original  development  cost 
remaining  at  end  of  planning 
period 

0 

Percent 

CIMD 

Average  cost  of  developing 
one  hour  of  instructional 
materi al 

30 

Do! lars 

Personnel 

Instructor  to  student 
position  ratio 

/.  0 

Decimal 

Ratio 

INTSPO 

SAL  I NR 

Annual  salary  and  benefits  of 
one  instructor 

Dollars 

-i — -- — i ' - ~ — t— r 1 

Supplies 

Cost  of  expendable  supplies  for 
each  student  while  enrolled  in 
course 

o 

Dollars 

SUPPLY 

Students 

Annual  salary  and  benefits  of 
one  student 

\ 

>/  /V/ 

Dollars 

STUDSL 

STCSTl 

Average  student  travel  cost 
to  and  from  school 

_ 

Dollars 

STCST2 

Average  per  student  travel  cost 
as  a part  of  course 

0 - 

Dollars 

Miscellaneous 

Number  of  years  in  planning  period 

/o 

Years 

N 

ARATE 

Attrition  rate 

Percent 

WATET- 

Discount  rate 

n. /O 

Percent 

WSCROP 

Weeks  school  operates  each  year 

SO 

Weeks 

TLENGH 

Average  time  spent  in  training 
medium  per  student 
(non- recycled  students) 

O.  / 

Weeks 

TLEGTH 

Average  hours  per  week  student 
spends  in  medium 

3 

Hours 

RCRATE 

Recycle  rate 

D 

Percent 

ARCYTM 

Average  time  the  recycled  student 
spends  repeating  material 

0 

Weeks 

ESP 

Percentage  of  excess  student 
positions  required  to  provide 
for  fluctuations  in  input 

o.os* 

Percent 

NOTE1'’  All  percent  values  are  entered  as  decimal  equivalents. 


Figure  6.  Sample  Cost  Data  on  Cost  Data  Collection  Form  (continued) 
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Figure  6.  Sample  Cost  Data  on  Cost  Data  Collection  Form  (continued) 
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Instructional  Delivery  System  Microfiche  with  Photo  Mockup 
Run  ID  Example  2 


FORTRAN  Symbol 

Variable  Description 

Value 

— __ — 

Units 

facilities 

— --I 

fAcost 

Total  facilities  acquisition 
and/or  refurbishing  costs 

0 

Dollars 

LOFFA 

Expected  years  of  life  of 
FACOST  assets  (in  whole  numbers) 

o 

Years 

SQFTIN 

Total  square  feet  required 
for  each  instructor 

Sq  ft 

SQFTsT 

Total  square  feet  required 
per  student  position 

7 S' 

Sq  ft 

SQFTAM 

Total  square  feet  required 
for  administrative  overhead 
for  all  student  positions 

JtTD 

Sq  ft 

Equipment 

EQCISP 

Equip,  implementation  costs 
Independent  of  stud.  pos. 

0 

Dol  1 ars 

LOFEQI 

Expected  years  of  life  of 
EQCISP  assets 

o 

Years 

EQIMPC 

Equip,  implementation  costs 
per  student  position 

3 IS 

Dollars 

lOfeiT- 

Expected  years  of  life  of 
EQIMPC  assets  (In  whole  numbers) 

...  JO 

Years 

TSPOSD 

Percent  o?  operating  time 
student  position  down 

.£m.Q  i 

Percent 

Figure  6.  Sample  Cost  Data  on  Cost  Data  Collection  Form 


32 


TAEG  Report  No.  16 


1 

U 

FORTRAN  Symbol 

Variable  DescriDtion 

Value 

Units 

8 

terfal  {(M) 

I 

O 

O 

UIMD 

% of  TLENGH  (i.e.,  time  spent 
in  training  medium)  for  which 
new  instructional  material 
must  be  developed 

Percent 

I 

-mm 

% of  original  development  cost 
required  each  year  to  maintain 
instructional  material 

Percent 

i. 

i 

5: 

o 

EViM  ■ " 

% of  original  development  cost 
remaining  at  end  of  planning 
period 

0 

Percent 

l 

J 

\ 

r 

o 

CIMD 

Average  cost  of  developing 
one  hour  of  instructional 
material 

RH 

Dollars 

f 

V 

o 

INT5P0 

Instructor  to  student 
position  ratio 

p.j 

Decimal 

Ratio 

1 

o 

sALFnr 

Annual  salary  and  benefits  of 
one  instructor 

Dollars 

S' 

Supplies 

o 

SUPPLY 

Cost  of  expendable  supplies  for 
each  student  while  enrolled  in 
course 

o 

Dollars 

( J 

Students 

l 

STUDSL 

Annual  salary  and  benefits  of 
one  student 

Dollars 

i ■ 

t 

< 

\ 

(...) 

stcsTT 

Average  student  traveT  cost 
to  and  from  school 

- o 

Dollars 

STCST2 

Average  per  student  travel  cost 
as  a part  of  course 

a 

Dollars 

i 

r ) 

Miscellaneous 

i 

N 

Number  of  years  in  planning  period 

ib 

Years 

\ 

m te 

Attrition  rate 

_ o. b4 

Percent 

DR  ATE 

Discount  rate 

n./& 

Percent 

i 

{ ) 

WSCHOP 

Weeks  school  operates  each  year 

Weeks 

£ 

1,  ! 1 

tlerst 

Average  time  spent  in  training 
medium  per  student 
(non-recycled  students) 

o.j 

Weeks 

V 

TLEGTH 

Average  hours  per  week  student 
spends  in  medium 

V 

Hours 

' 1 

( 

RCRATE 

Recycle  rate 

Percent 

ARCYTM 

Average  time  the  recycled  student 
spends  repeating  material 

a/ 

Weeks 

' 

■ 

ESP 

Percentage  of  excess  student 
positions  required  to  provide 
for  fluctuations  in  input 

Ot  O'lT 

Percent) 

NOtE:  All  percent  values  are  entered  as  decimal  equivalents. 


; v Figure  6.  Sample  Cost  Data  on  Cost  Data  Collection  Form  (continued) 
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Figure  7. 


Sample  of  Summary  Cost  Data  for  Two  Delivery  System 
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Choose  the  Cost-Effective  Instructional  Delivery  System  or  the  Mix  of 
Systems.  The  selection  of  one  or  a mix’  of  the  alternative  Instructional 
delivery  systems  and  the  justification  of  this  choice  Is  based  on  data 
organized  in  all  three  previous  steps  of  the  TECEP  process.  This  final 
act  of  choosing  a delivery  system,  however,  cannot  be  procedural i zed. 
While  the  low  cost  solution  should  be  considered  a prime  candidate,  the 
training  system  designer  must  still  weigh  the  variations  in  cost  among 
ine  useful  delivery  approaches,  along  with  the  relevant  administrative 
.actors  that  influence  the  selection  of  a delivery  system  irrespective 
of  technical  solutions. 

Figure  8 provides  a sample  of  this  final  act  of  the  selection 
process. 
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Analysis  of  Delivery  Systems  for  Operator  Training  on  the 
Hev/lett  Packard  61 4A,  RF  Signal  Generator 


TRAINING  TASK: 


TRAINING  SETTING: 


ALTERNATIVE 
INSTRUCTIONAL 
DELIVERY  SYSTEMS: 


ANALYSIS: 


Given:  (1)  an  operational  RF  signal  generator, 

Hewlett  Packard  614A,  (?)  the  characteristics  of 
the  signals  to  be  generated,  and  (3)  the  operator's 
checklist,  the  trainee  will  operate  the  equipment; 
i.e. , he  will  describe  and  then  perform  each  step 
in  the  equipment  turn-on  and  set-up  procedure, 
proceeding  through  the  checklist  without  error. 

Using  an  appropriate  instructional  module,  the 
school  must  train  an  average  of  1190  students  per 
year  for  approximately  10  years.  These  students  will 
use  the  RF  signal  generator  in  laboratory  exercises 
iirniediately  following  the  completion  of  this  module 
as  well  as  at  their  duty  station  at  the  completion 
of  the  course.  The  school  house  will  be  open  for 
student  use  8 hours  per  day,  5 da^s  per  week, 

50  weeks  per  year.  The  school  uses  individualized 
instruction,  criterion  performance  measurement 
techniques,  accepts  students  at  any  time,  and  allows 
students  to  leave  the  program  as  soon  as  they  achieve 
criterion  performance.  A fairly  even  flow  of  students 
has  been  programmed  through  the  training. 

System  A:  The  student  uses  an  operational 
unit  of  the  Hewlett  Packard  61 4A  RF  Signal  Generator 
with  a tutor  as  an  instructor  and  evaluator.  The 
instruction  is  performed  in  a laboratory  setting. 

System  8:  The  student  uses  a microfiche-based 

self-instruction  system  with  a photo  mock-up  of  the 
Hewlett  Packard  614A  RF  Signal  Generator.  This 
self-instruction  is  performed  in  a carrel.  An 
instructor  serves  as  an  evaluator. 

The  training  objective  can  be  achieved  using  either 
system.  Both  are  individualized  approaches  to 
instruction  and  therefore  will  fit  into  the  individual- 
ized structure  of  the  school.  The  significant 
differences  between  the  two  approaches  are  summarized 
in  the  following  chart: 


Figure  8.  Sample  Report  on  the  Analysis  of  Proposed 
Instructional  Delivery  Systems 
37 
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Acquisl tion 
Cost  for 
Facilities, 

Average 

Equipment  and 

Discounted 

Uniform 

Instructional 

Present 

Cost  Per 

Annual 

Material 

Cost 

Graduate 

Cost 

Development 

System  A 

Operational 
System  with 
Tutor 

$460K 

$39 

$71 K 

$7. 7K 

System  B 

Microfiche 
with  Photo 
Mock-up 

$21  6R 

$18 

$34K 

S1.2K 

_____  _ _ _ zm 

No.  of 

Non- 

] 

Instructors 

Discounted 

NO.  of 

(in  man- 

Annual 

Student 

Average  Hours 

years  per 

Instructor 

Posi  t.ions 

Per  Graduate 

year) 

Cost 

Required 

In  Module 

System  A 

Operational 
System  with 
Tutor 

2.6 

$42  K 

2.6 

3 

System  B 

Microfiche 
with  Photo 
Mock-up 

.3 

$4  K 

2.6 

4 

NOTE:  The  summary  data  in  this  figure  appears  also  in  figure  7. 


Figure  8.  Sample  Report  on  the  Analysis  of  Proposed 
Instructional  Delivery  Systems  (continued) 
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1 


RECOMMENDATION: 


All  economic  indicators  point  to  System  A being 
significantly  more  expensive  than  System  B.  The 
three  overall  cost  indicators,  the  present  cost, 
average  discounted  cost  per  graduate,  and  the 
uniform  annual  cost,  all  indicate  that  System  A 
will  be  more  than  twice  the  cost  of  System  B.  Also, 
the  initial  acquisition  cost  of  System  A is  over 
seven  times  the  acquisition  cost  of  System  B. 
Instructor  support  is  about  10  times  more  costly  for 
System  A than  for  System  B. 


The  number  of  student  positions  required  is 
essentially  the  same  even  though  System  B may 
require  one-third  more  student  man-hours  than 
System  A.  The  apparent  increase  in  efficiency  of 
System  A is  lost  in  that  only  two  students  a day 
would  normally  be  scheduled  into  each  student 
position.  Tutoring  requires  almost  10  times  more 
instructor  man-hours  than  using  an  instructor  only 
for  evaluation. 


The  use  of  System  B,  the  microfiche-based  approach, 
involves  a higher  level  of  risk  than  does  the  use  of 
System  A.  Tutoring  is  the  traditional  solution, 
and  a microfiche-based  self-study  approach  is  an 
innovative  approach  with  a limited  number  of 
instance^  of  actual  use.  However,  the  significance 
of  the  risk  with  System  B is  low  in  that  the  cost 
of  trying  the  microfiche  approach  with  this  module 
is  low,  both  in  dollars  and  man-horrs.  While  micro- 
fiche are  not  presently  being  used  to  learn  the 
operating  procedures  fcr  signal  generators,  the 
technique  is  being  successfully  employed  in  learning 
the  checkout  and  operating  procedures  for  other 
electromechanical  devices. 


Use  System  B,  the  microfiche-based  system  with  a 
photo  mock-up.  The  potential  dollar  savings 
inherent  in  this  approach,  when  compared  with  the 
other  alternative,  provides  an  adequate  basis  for 
accepting  the  low  level  risk  involved  in  attempting 
to  use  the  innovative  microfiche  approach. 


Figure  8,  Sample  Report  on  the  Analysis  of  Proposed 
Instructional  Delivery  Systems  (continued) 
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TABLE  2.  TVKLV#  TYPES  OF  LEARNING  ALGORITHMS  WITH  THE 

CHARACTERISTICS  OF  TRAINING  OBJECTIVES  THEV  SUPPORT 
(See  TAEG  Report  23  for  actual  a.Vgorlthma) 


NAMES  OF 
LEARNING 
ALGORITHM 

CHARACTERISTIC'.  OF  TRAINING  OBJECTIVES  THAT  CAN  BE  ACHIEVES  WITH 
SPECIFIC  ALGORITHMS 

ACTION 

VERBS  BEHAVIORAL  ATTRIBUTES  EXAMPLES 

1.  RECALLING 

Answer 

1.  Concerns  verbal  or 

1.  Recalling  equipment  nom*n- 

BOO  US  or 

Define 

symbolic  learning. 

clature  or  functions. 

KNOWLEDGE 

Exprcan 

2.  Concerna  acquisition  and 

2.  Recalling  system  functions. 

Inf arm 

long-term  maintenance  of 

such  as  the  complex  nils- 

Select 

knowledge  ao  that  it  can 
be  raculied. 

tions  between  system  input 
end  output. 

3.  Recalling  physical  lews, 
■uch  as  Ohm's  lsw. 

4.  Recalling  specific  redlo 
frequencies  snd  other 
discrete  facts. 

2.  USING 

Apply 

1.  Concerna  the  practical 

1.  Based  on  acsdemlc  knowledge. 

VERBAL 

Arrange 

application  of 

determine  which  equipment  to 

INrORMA- 

Choose 

in format ion. 

use  for  e specific  real 

TION 

Compare 

2.  Generally  follove  the 

world  task. 

Determine 

initial  learning  of 
information  through  the 
use  of  the  guidelines 
for  Recalling  Bodies 
of  Knowledge. 

3.  Limited  uncertainty  ot 
outcome. 

4.  Usually  little  thought 
of  other  alternatives. 

2.  Baaed  on  an  academic  knowl- 
edge of  the  system,  compare 
alternative  modes  of  opera- 
tion of  a piece  of  equipment 
and  <*  temi.no  the  appropri- 
ate mode  for  a specific  real 
world  situation. 

3.  Buoed  on  memorized  knowledge 
of  radio  frequencies,  choose 
the  correct  frequency  in  a 
specific  real  world  sltua- 

t ton . 

3.  RULE 

Chooee 

1.  Choosing  a course  of 

1.  Apply  the  "rules  of  the 

LEARNING 

Conclude 

action  baaed  on  apply- 

road." 

AND  USING 

Deduce 

lng  known  rules. 

2.  Solve  mathematical  equatlo.it 

Predict 

2.  Frequently  involves 
"If... Then"  situations. 

(both  choosing  correct 

Propose 

equation  and  the  mechanics 

Select 

3.  The  rules  are  not 

of  solving  the  equation). 

Specify 

questioned , the  decision 
focuses  on  vherher  the 
correct  rule  Is  being 
sppiled . 

j.  Carrying  out  military 
proi ocol. 

4.  Selection  of  p-oper  tire 
extinguisher  for  different, 
type  fires 

5.  Using  correct  gratmoat  in 
novel  situations,  covered 
by  rules. 

4.  MAKING 

Chooee 

1.  Choosing  s course  of 

1.  Choosing  1 requunciee  to 

DECISIONS 

Design 

action  when  alternatives 

search  in  an  ECH  search  plan. 

Diagnose 

are  unspecified  or 

2.  Chooalng  torpedo  setting/* 

Develop 

unknown. 

during  n torpedo  attack. 

Evaluate 

2.  A successful  course  of 

3.  Threat  evaluation  anf.  weapon 

Forecast 

action  la  not  readily 

assignment. 

Formulate 

apparent . 

4.  Choice  of  tacll'is  La  con- 

Organlre 

3.  The  penalties  for  unsuc- 

hat  - wide  range  of  opticas. 

Select 

ceaaful  coursas  of 
action  are  not  readily 
apparent . 

4.  The  relative  value  of 
porsible  decisions  must 
be  ccmsiderad  - includ- 
ing posalble  trade-offs. 

5.  Frequently  Involves 
forced  decisions  made  in 
a ahort  period  of  time 
with  soft  information. 

5.  Choosing  e dloqnwLc 

strategy  in  dealing  with  a 
malfunction  in  a co'iplex 
piece  of  equipment, 
o.  Chocs lng  to  abort  or  c^nmit 
oneself  to  lend  upon  reach- 
ing tha  critical  point  1a 
the  glidepath. 

Preceding  page  blank 
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TVXLYE  TTf  iS  Of  LXAANINC  ALCOR1TMS  WITH  THE  CKAAACT  EXIST  ICS 
OE  TRAINING  OUECTIVEfl  THEY  SUE  POET  (eotitlmud) 

(Dm  I AEG  Export  21  Ear  actual  al|orlttwa) 


^ I 

'4 


s 

l- 

1 . , 

4 

■ft  J 


HANKS  OP 
LttARMING 

5.  rmtctinG 


Detect 
Dlatlngulsh 
Haul tor 


2.  Low  threshold  cues] 
signal  to  nolss  ratio 
may  bs  vary  low;  early 
awareness  ok1  sitall  cues. 

3.  ftern  for  a wide  ran*e  of 
cuos  for  a given  "taroet" 
and  for  different  types 
of  "targets." 


periscope  of  a anorkeUng 
submarine  during  day t lea 
operation*  In  a aaa  state 
of  chraa. 

Detact,  through  a alight 
change  In  sound,  a baarlng 
starting  to  burn  out  It.  a 
pwar  generator. 


CLAKSirY- 

INC 


Identify 
Recognita 
Dlffsr- 
anclata 
Clean tfy 


7.  IDENTIFY- 
ING 

BYHBOLS 


Identify 

Read 

Transcribe 


8.  VOICE 
CJHHUNI- 
GATING 


1.  Pattorn  recognition  np- 
proach  of  identifica- 
tion - not  problee 
solving. 

2.  Classification  by  non- 
verbal characteristics. 

3.  Status  determination  - 
ready  to  start. 

4.  Object  to  he  classified 
can  be  viewed  from  many 
perspectives  or  in  many 
forma. 


1.  Involves  the  recognition 
of  syubols. 

2.  Symbols  to  be  identified 
typically  are  of  low 

! meaningfulnesa  to 
untrained  porejns. 

3.  Identification,  not 
interpretation,  is 
emphasized. 

4.  Involves  storing  queue* 
of  symbolic  information 
and  related  meanings. 


j Advise  1.  Speaking  nnd  listening  ! 

Jnauet  in  specialized 

Comnamlcste  languages. 

Converse  2.  Often  involves  the  uae 

Direct  of  a specific  message 

Express  model.  Standard 

Instruct  vocabulary  and  format. 

Interview  3.  Also  concerns  clarity  of 
Listed  voice,  enunciation. 

Order  speed . 

Report  4,  Timing  of  verbal itation 

Speak  is  usually  critical  - 

whan  to  pass  Informa- 
tion. 

3.  Typically  characterized 
by  redundancy  in  rerma 
of  Information  content. 

I 6.  Involves  extensive  use 

of  previously  overlcarticd 
verbal  skills,  or  over- 
costing  over]  earned  Intel - 
faring  patterns. 

I 7.  Teak  may  be  JAfflcvlf  dmi 

j 1 to  presence  of  bmckjgrota*  l 

1 nniao. 


1.  Claaalfy  a sonar  target  as 
"sub"  or  "non-sub." 

2.  Visual  classification  of 
flying  all  craft  aa  "friend" 
or  "enemy"  or  as  an  1 7-4, 

3.  Determining  that  an  identi- 
fied noise  Is  a wheel  bear- 
ing failure,  not  a water 
pump  failure  by  rating  the 
quality  of  the  noise  - not 
by  the  problem  solving 
approach. 


1.  Reading  electronic  symbols 
on  a acheraclc  drawing. 

2.  Identifying  mar  symbols. 

3.  Reading  and  transcribing 
aymbolu  on  a tnctical 
status  board. 

a.  Identifying  symbols  on  « 
veatUtr  nap. 


Officer  giving  oral  orders 
and  receiving  reports. 

Sonar  operator  passing  oral 
information  over  communi- 
cation net. 

Instructions  by  GCA 
operator  to  pilot  in 
landing  aircraft. 
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TAILS  2.  TWELVE  TTPES  Of  LEARNING  ALCGNITMS  WITH  TUX  CHARACTERISTICS 
or  TRAINING  OE5ECT1VU  TUXY  SUPPORT  (continued) 

(Sn  TA1Q  laporc  2)  for  actual  algorithm#) 


NAMES  or 
LEARNI W2 
ALGORITHMS 

CHARACTERISTICS  OP  TRAINING  OBJECTIVES  THAT  CAN  11  ACHIEVED  WITH 
SPEC I/IC  ALGORITHMS 

ACTION 

VERBS  BEHAVIORAL  ATTRIBUTES  EXAMPLES 

9.  RECALLING 
PROCEDURES , 
POSITIONING 
MOVEMENT 

Activate 

Adjuat 

Align 

Aaeexbla 

Calibrate 

Disassemble 

Inspect 

Operate 

Service 

1.  Concern#  the  chaining  or 
sequencing  of  event*. 

2.  Include*  both  the  cogni- 
tive end  Motor  aepecte 
of  equipment  set-up  end 
operating  procedure*. 

3.  Procedural  checU  llete 
ere  frequently  toed  ae 
job  eld*. 

1.  Recalling  equipment 
aeaembly  end  disassembly 
procedure# . 

2.  Recalling  the  operation 
and  check  out  procedure# 
for  a place  of  equipment 
(cockpit  check  llete) . 

3.  Following  equipment  turn-on 
procedure#  - amp her la  on 
motor  behavior. 

10. STEER INC 
AND 

GUIDING  - 
CONTINUOUS 

MOVEMENT 

Control 

Guide 

Maneuver 

Regulate 

Steer 

Track 

1.  Tracking,  dynamic  con- 
trol : e percept uaL-motor 
akill  involving  contin- 
uous pursuit  of  e target 
or  keeping  dial*  at  a 
certain  reading  ouch  a* 
maintaining  constant 
turn  rates,  etc. 

2.  Compensatory  movement* 
based  on  feedback  froe 
displays. 

3.  Skill  in  tracking 
requires  emooth  isuscle 
coordination  pattern*  - 
leek  of  overcontrol. 

4.  Involve*  estimating 
chengoa  In  position*, 
velocities,  accelera- 
tion#, etc. 

5.  Involve#  knowledge  of 
d lap ley-control 
relationships. 

1.  Submarine  bow  and  atarn 
plane  operators  maintaining 
s constant  couraa,  or 
making  changes  in  couraa  or 
depth. 

2.  Tank  driver  following  a 
road. 

3.  Sonar  operator  keeping  the 
cursor  on  a sonar  target. 

4.  Air-to-air  gunnery  - target 
tracking, 

5.  Aircraft  piloting  such  eat 

visually  following  a 
ground  path. 

b.  Helmsman  holding  a course 
with  gyro  or  magnetic 

compass. 

11. PERFORMING 
GROSS  MOTOR 
SKILLS 

Cue 

Draft 

Draw 

March 

Mix 

Run 

Sew 

Sharper 

Splice 

Swla 

Weld 

Write 

1.  Perceptual-motor 
behAVlor-eephasla  -jn 
motor.  Premium  on 
manual  dexterity,  occa- 
sionally atreryth  and 
endurance . 

2.  Repetitive  mechanical 
skill. 

3.  Standardised  behavior, 
little  room  for  varia- 
tion or  Innovation. 

4.  Automatic  behevlor  - 
low  level  of  attention 
la  required  In  skilled 
operator.  Kinqathytlc 
cues  dominate  control  of 
behavior. 

5.  Fatigue  or  boredom  may 
become  e factor  when 
skill  is  performed  over 
an  extended  period  of 
time  or  at  a rapid  late. 

6.  Pine  tolerances. 

7.  Often  a component  of  • 
larger  teak. 

1.  Use  of  hand  tools  such  as 
hammer,  saw,  wrench,  or 
power  tools  such  as  lathes 
or  grinders. 

2.  Running  « drill  press  In  an 
assembly  line. 

3.  Loading  ammunition  Into 
artillery  pieces  or  5" 
guna. 

4.  Drafting  - uae  of  drafting 
instruments. 

5.  Painting  - house  painting 
or  preserving  ship  hull, 
etc. 

f*  Marching  - close  order 
drill. 
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TAILS  2.  TWELVE  TTPIS  Ok'  LEARMIMG  ALGORITHMS  WITH  THE  CHARACTERISTICS 
OF  TRAWIHC  0 EJECT  IVES  THEY  SOfFOIT  (continued) 

(Sm  TAKG  Report  23  for  actual  algorithms) 


MAKES  OR 
LEAKS  IMG 

ALGORITHMS 

CHARACTERISTICS  Of  ftAXMUK}  OEJBCTIVES  THAT  GAM  IE  ACHIEVED  WITH 
EMCIflC  ALOOHXTMK8 

ACTIOH 

VEKftS  BEHAVIORAL  ATTRIBUTES  EXAMPLES 

12.  ATTITUDE 

LEAKS  IMG 

Abide 

Accept 

Approve 

Comply 

Testify 

1.  Gintcarna  sahib icing  a 
pattern  of  behavior 
consistent  with  an 
attitude  or  value. 

2.  Concern#  willingness  to 
perforu  according  to  e 
■tandard  ae  opposed  to 
eklll  to  per tore  accord- 
inf  to  that  standard. 
(Hotel  A pereon  can 
have  a high  level  of  eklll 
but  chooee  not  to  perform 
in  a ekiilf » l Manner.) 

3.  Concern*  integrating  or 
organising  a value  or 
attltuda  into  a pattern 
of  behavior. 

1.  Complying  with  known  aafaty 
■ tender da  while  performing 
e maintenance  procedure  on 
e high  voltage  supply  in  e 
radar  eat. 

2.  Conforming  to  the  a tandard 
ol  keeping  one' a bunk  area 
neat  and  clean  whan  the 
opportunity  exists  to  do 
otherwise. 

3.  Abiding  by  security  regu- 
lations when  handling 
classified  Information. 

4.  Accepting  the  need  to  take 
risks  when  necessary  to 
protect  the  lives  of 

5.  Complying  with  a request 
to  repair  a malfunctioning 
radio  circuit  with  graater 
than  normal  apaad  whan  a 
quick  response  la  required. 

V 


wfsamgn. 
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TABLE  3.  INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


RECALLING  BODIES  OF  KNOWLEDGE 

^ Al  ternetiveln  struct  ions  l T^TvTr^^yTta** 


To  ohooia  « delivery 

■YBtMl 

1.  Place  * v*  (light 
pencil)  in  boxes 
represent lng  criteria 
(rows)  that  suat  ba  Met. 

* 2 < Saiact  the  delivery 
ayatesa  (oolu«n«)  that 
have  an  "Xa  In  each  row 
designated  by  a "</'* 
These  are  the  candidate 
k delivery  ays  toes. 


Delivery  Approaches 
Permitting  the  Application 
of  All  Learning  Guidelines 
and  Algor i the 


Delivery  Approaches  MOT 
Per sitting  Csspictc 
Application  of  Learning 
Guidelines  and  Algorithm 


Critaria  for 
Select ing 
Instructional 
Oel i very 
systasa 


8t ieuius  Criteria 

• 

Visual 

Novemen t 

• 

Visual 

Limited 

Full 

Spectrus 

• 

Audio 

Full  Color 

voice  Sound 
Pull  Sound 

Range 

Range 

Training  Setting  Criteria 

• individual  Trainees  at  Fixed  Location 

• Individual  Trainees  with  Simultaneous 
Instruction  dt  Hiny  Locations 

• Individual  ‘ "aineei  with  Independent 
Instruction  at  Any  Location 

0 Swa  1 1 Group 

• Large  Group  at  a Single  Location 

• Teas  Setting 


•I' !:J 
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TABLE  5.  IKSTRUCTION/U.  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


To  nhooaa  a delivery 

ayatMi 

1.  Place  a "JH  (light 
pencil)  in  boiti 
representing  criteria 
(row«)  that  must  ha  aat. 


AND  LiatMC 


Delivery  Approach** 
Permitting  the  Application 
of  Ml  Learning 
guidelines  and  Algorithm 


Delivery  Approecl.ee  MOT 
Permitting  Complete 
Application  of  Learning 
guidelines  and  Algorithm 


3.  Select  the  delivery 
eyateaa  (coluana)  th«L 
have  an  "A"  in  each  row 
designated  by  a • 
Theea  ere  the  candidate 
k delivery  ryitiai. 


Criteria  for 
Selecting 
I nn'iCUct  Iona ) 
Delivery 

Syateaa 


J 0 «J  M 3 u o a 

30  ec  n a o * 

* a ~t  m Veil  3 

J -o  3 U *>  V Q- 

■ c a -j  o m u n 


• Vlaual  Kora 


Pictorial,  Plane 

Line  Conatructlon,  Plane 


Object , Solid 


Vlaual  Moveaent 


• Visual  Spactrua 
r.ray  Scale 


Voice  Sound  Rang* 
roll  Sound  Manga 


JL  _>L  * I m _x_ 

xxx  TTiLfiT 


x x x 


X X X IX  X X I 

XXX  IX  X 


__x }LJL 

X 1~~ 


Interna'.  Stimulus  NoMon 
Cum 


External  Stimulus  Notion 

Cuee 


1 Setting  Criteria 
1 Trainee  at  riaed  Loca t ion 
i Trainee  with  Independent 
on  at  Any  Locat ion 


•J  Seal  1 Croup 
• Large  C 


P at  a Single  Location 


x ixixlxlxlxlxl 


V Site  of  Courseware  and  Special  lijrd- 
wera  Development 


I m*#"I  ‘.'id*  of  Acquisition  Coat 


X_  X I X x 

X X XXX  in  X 


X X X I X lx 
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TAEG 


TABLE  9.  INSTRUCTIONAL  DELIVE 


IDEM 


Directions t 


To  choose  a delivery 
system i 

1.  Pl»c«  * -J"  (light 
pencil)  in  boxes 
representing  criteria 
(rows)  that  suat  be  net. 

2.  Select  the  delivery 
uyatPMi  [colusna)  that 
have  an  "X"  in  each  row 
designated  by  a . 


• individual  Trainee  with  Independent 
Inatruction  at  Any  Location 


Administrative  criteria 

• site  of  Courseware  and  Special  Hard- 
ware Development 


Local 


Central 

# Magnitude  of  Acgi.iai  t ion  Cost 
Low 


High 
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TABLE  10.  INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


VOICE  COMMUNICATING 


To  ctiooen  a delivery 
■ yaLftM  i 

1 . Place  a •/"  (llijht 
pencil)  in  boxes 
representing  criteria 

(ro«a)  that  nun  bo  ntl , 

2 . Select  the  delivery 
Hynteitb  (columns)  tlia* 
hevir  an  “X“  » •*  each  row 
■I i- 1 igiiated  by  a "J"  . 


□ el  ivory  A p |>  r oac  Me  a 
Permitting  the  * f*|i  lie#  t 1 
uf  All  Learning  Guldeliii 
and  A 1 uor i t )im 


fit  i mil  I ii  u Criteria 

• Viuuul  lu:m 

I'iCCCI  1 A 1 i I’  liUM* 
Sol  id  ')h  )<  ft 

• vuuul  Movement 

St  l 1 1 

Pull  MOYi'l>Ullt 

• And  i ii 

Voice  Hvuinl 
Arbi 


Ailm  i n l 

«s  trot 

iV'j  criteria 

* ill 

to  - >1 

Com  in* wo  re  and 

Sp 

fC  1 .1  1 

Hardware  Development 

1.0 

. .» l 

Co 

n t r a 1 

• M.i 

'I:.  MikI'*  of  AC'iuinitiun  O'flt 

1..* 

- 

II  1 

Delivery  Appi  Oil 

vh'-H  NOT 

Permi tt ing  Comp 

1 l*  1 c 

t »ipl  1 cat  von  of 

L r j a r n i 1 1 g 

Cu  i il«  1 » ne  n a nd 

Alijur  ! t Inn 

I- 
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TABLE  13.  INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


PERFORM! INS  GROSS  MOTOR  SKILLS 


D i raationa  i 


Tc  ohooi 

• ya  tea i 


1 . Placa  a (light 

pencil)  in  boxes 
representing  oritaria 
(rova)  that  suat  be  aet. 


Altcrnativ  i I nsf..ruo  tioual  Delivery  syeteaa 


Delivery  Approanhea 
Paraittlny  tha  Application 
of  All  Learning  Guidelines 
and  Algoritha 


Dalivary  / pproaahaa  NOT 
Poraittln.  Complete 
Applloati  in  of  Learning 
Guidelines  and  Algorithm 


Cri  Lurii  for 
Selecting 
Instruct  Iona  1 
Delivery 
Systems 


2.  Select  tha  dalivary 
aystaaa  (columns)  that 
hava  an  "X**  in  aach  row 
designated  by  a 
These  art  tha  oandidata 
dalivary  ayataua. 
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Training  setting  criteria 

• 

Individual  Trainee 
Fixed  Location 

at  a 

• 

Individual  Trainee  with 
independent  instruction 
at  Many  Locations 

• 

Small  Group 

• 

Team  Sett.  Lng 

Administrative  criteria 


Site  of  Courseware  Development 
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TABLE  14.  INSTRUCTIONAL  DELIVERY  SYSTEM  CHART  FOR  THE  ALGORITHM 


This  chert  la  weafal  ir  eoleetleg  an  J.natruc tional 
delivery  tyatta  for  tka  affective  and  behavioral 
aonponenue  of  attitude  learning.  For  achieving  the 
cognition  component  uaa  instructional  delivery 
I ay  a teal  auggeated  for  racollirg  bodies  of  knowledge 


ATTITUDE  LEARNING 


Alternative  inat ruct ional  Delivery  Syet-amn 


To  chooae  a delivery 

aye tea i 


1.  Place  a *J*  (. lght 
pencil')  in  boxes 
representing  criteria 
(town)  that  suit  be  aet 


Delivery  Approaches 
Permitting  the  Application 
of  All  learning  Guidelines 
and  Algorithm 


Delivery  Approaches  NOT 
Permitting  Complete 
Application  ol  Learning 
Guidelines  and  Algorithm 


l.  Select  the  delivery 
aye  teas  (column)  that 
have  an  ’'XH  in  oath  row 
dan  iv/na  tad  by  a mJ*  , 
These  are  the  car  Udate 
delivery'  eysteae. 


Criteria  for 
Soleo  ting 
tiiutruoti  onal 
Delivery 
System* 


Training  Setting  Criteria 


# Individual  Trainee  at  Fixed  Location 


•b  Individual  Trainee  with  Independent 
instruction  at  deny  Location* 


• Sm.-.ll  Group 


Team  Setting 


Administrative  Criteria 


• Site  of  Courseware  Development 


• Magnitude  of  Acquisition  Coat 
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APPENDIX  A 

ALTERNATE  APPROACH  FOR  STEP  TWO 

Step  2,  as  presented  In  section  III,  Is  a "by-the-numbers"  procedure. 
It  is  a simple  sequence  of  events  for  selecting  delivery  systems,  but  In 
its  simplicity  It  eliminates  the  chance  for  Innovation  or  for  a sensitive 
response  to  special  conditions.  An  alternative  approach  restore;'  the 
possibility  of  responding  to  special  conditions.  The  alternate  approach 
contains  the  following  steps: 

First,  study  the  appropriate  set  of  learning  guidelines  and  algorithms 
In  TAEG  Report  23.  Modify  the  algorithms,  as  required,  to  accommodate 
the  required  training  tasks. 

Second,  list  those  media  characteristics  from  table  15,  Generic 
Characteristics  of  Training  Media,  required  to  carry  out  the  intent  of 
the  algorithm  with  the  training  objectives.  As  an  example,  a specific 
training  objective  matched  with  an  algorithm  may  require  an  instructional 
delivery  system  with  the  following  set  of  basic  characteristics. 

Visual  form: 

Visual  alphanumeric 
Visual  pictorial  plane 

Visual  Movement: 

Visual  still 

Visual  Spectrum: 

Color 

Audio: 

Voice  sound  range 

Trainee  Response  Modes: 

Multiple  choice 


9 James  A.  Aagard  and  Richard  Braby,  Learning  Guidelines  and  Algorithms 
for  Twelve  Types  of  Training  Objectives,  'rAEG  Report  No  <Z.  Tfuiwlnq 
Analysis  and  Evaluation  Group,  OrlandoT  Florida  (manuscript  form,  to 
be  published  mid-1975). 
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TAgLR  IS,  GENERIC  C1URACTEMIITICS  07  TRAINING  KEG  LA 


STIMULUS  CAPAIILlTIIf 


Viaual  fora 

I. 


Viaual  Alphanumeric  - word*,  nuafaaia  ud  ocher 
symbols  >pr aa«A ted  graphical J y . 

Viaual  PAct-vilal.  Plant  - » two -dime**#  local 
1m|i,  alrupiiataucloii  in  the  form  Of  4 
photograph  ot  drawing. 

visual,  Uhs  Con-mucflon.  r|w--  - • two* 
dlMulonjil  figure  Mae  of  lines,  such  M 
e mathematical  curve  or  graph. 

Visual  Otolwct,  Solid  - a thrta-dimenaional  imagt 
or  raalitylthat  ia  viewed  fro*  exterior 
perapectlWa. 

Viaual  Invllrongant  - A three-diaetta tonal  (,M|« 
or  seallty  -that  ia  viawad  ftoa  inside. 


Vlim)  Ho  van  t 


Visual  Still1  - a static  viaual  field,  ee  with  a 
■dll  photograph,  drawing,  or  printed  page. 

Viaual  Llatcsd  Movement  - a basically  atatic 
viaual  flald  with  elements  that  can  he  aada  to 
move,  aa  with  an  animated  tranaparency  or  simple 
panel  with  awl  tehee  mat  wove. 


w^ti 


Viaual  Full  Movement  - a viaual  field  in  which 
all  elements- cl»n  aova,  aa  with  a motion  picture, 
flight  simulator,  or  operational  aircraft. 

Viaual  Cyclic  Movement  - a viaual  S.UM  which 
moves  through  ei  fixed  aoqu«nc«  and  then  rapeate 
tha  aaquanca  Inla  repetitive  aanner,  ae  with 
a file  loop.  \ 


Viaual  Spectrum 

10. 


Hack  and  Uhlta  a viaual  field  cor.poaad  of 
either  black  or  w^lte  elements,  aa  with  the 
printed  page  or  Una  drawing*, 

Cray  Scale  - a vitual  field  composed  of  black, 
white  and  continuous  gradallona  of  gray,  aa 
with  a black  and  white  photograph  or 
television  picture! 

Color  - a visual  field  coapoaed  or  varloua 
segments  of  the  viaual  apectrua,  re  with 
color  television  or > motion  picturea. 


Exact  Beale  - actual l viaual  flald  or  a one-to- 
one  replication  of  that  field  aa  with  a full- 
ailed  mock-up,  eiaulaltor,  or  operational 
ayatea. 

Prop<  > : lonai  Scale  - 4 represents t ion  i 
reality  vn  other  than  l!ull  acale,  euch  ai  a 
acaled  model  aap  or  photograph. 


Voice  sound  Range  - a limited  quality  of 
sound  which  eneblaa  spoken  worda  to  be 
used  oa  tha  medium  of  cowunlca clone,  but 
not  suited  to  more  demanding  taeke,  euch 
aa  music  or  sound  recognition  exercises. 


Full  gowad  Range  - a q-iallty  of  aound  reproduction 
that  cent alna  all  tha  significant  elaaenta  of  tha 
eoumd  aad  ia  eulted  to  tha  demanding  teak  of 
aound  recognition  exerclaaa. 

Ambient  Round a - a couplet  aound  anvlronaent  with 
sounds  emanating  from  varloua  aources  and  froa 
varloua  direct lona,  including  background  no  lea 
and  teak  algnlficent  sounds. 


Other 

19,  tactile  Cues  - signals  recslved  through  tha  nnes 
of  much,  Including  sensations  related  to  text  ms, 
alas  or  aha pa . 

19.  Internal  Stimulus  Motion  ruas  - the  cense t lone 
fait  by  a parson  whan  ha  aovaa  his  am,  tag, 
fingare,  ate* 

20.  External  Stimulus  Motion  Cuea  ••  the  sensations  felt 
by  a pareun  when  he  la  moved  by  aooa  outside  force 
in  such  a way  that  hia  body  experiences  roll, 
pitch,  yaw,  heave,  away  and/or  aurge. 

TRAINEE  RESPONSE  WOOES 

21.  Covert  Response  - a response  which  the  trainee 
craataa  In  hia  aind  but  dess  not  axpraas  in  an 
observable  aanner. 

22.  Multiple  Choice  - a response  node  in  which  a 
trainee  selects  a response  froa  a Halted  aet  of 

responsea. 

23.  Pra-prograamcd  Verbal  Performance  - a raspona* 
aode  in  which  a trains*  creates  a abort  answer 
to  a question  having  a Halted  aet  of  correct 
answers , 

24.  Eret-Stylft  Written  Performance  - a response  node 
in  which  a trainee  writes  a reaponee  In  hia  own 
worda. 

25.  Decision  Indicator  - a verbal  or  perceptual 
wocor  r>  aponse  in  which  tha  trainee  Indicate# 
that  ho  haa  made  a divergent  type  decision. 

26.  Voles  Performance  - a reaponaa  mode  in  which  a 
trainee  speaks,  including  conversation, 

27.  Pine  Movement  Manipulative  Acta  - a response 
aode  In  which  a trainee  makes  discrete  and 
■moll  movements  of  dials,  twitches,  keys  or 
aakaa  sensitive  adjustment*  to  Instruments* 

Act  muy  involve  uie  of  email  instruments. 

26.  Broad  Hovetsant  Manipulative  Acta  - a reaponee 
mods  In  which  a trainee  makes  large  aovenenta 
of  levera  or  wheels  on  large  pieces  of  equip- 
ment or  by  the  une  of  hand  held  tools. 

2y.  Tracking  - a response  aode  in  which  a trainee 
continuously  controls  a constantly  changing 
system,  ouch  aa  steering  en  automobile  or 
holding  •;  compass  bearing  in  steering  a ship. 

10.  Procedural  Manipulative  Acta  - a reaponee  mode 
In  uhlch  a trainee  performs  the  sequence  of 
steps  in  a procedure,  such  as  In  the  carrying 
out  of  tha  items  on  rhe  checklist  for  pre- 
fllghting  an  aircraft  or  turning  on  a radar 
ayetaa. 
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t«U  IS.  oonrc  OUUUCTWITICS  0*  TUiailW  KEDU  (contli.uod)  \ ' 


V 

IHFMWATIQN  FgttleCX  LOGIC 

43.  Cyclic  - a special  case  of  linear  sequence  In 

which  * limited  segment  of  a linear  program  le 

Form  of  Feedback 

repeated  continuously  throughout  a period  of 

J M 

time,  aa  with  e film  loop. 

1 1 

31.  Utrtnalc  Feedback  - inforwatioa  the  trainee 

Vi/ 

receives  from  hla  own  ln'Lirul  movements  or 

44.  1 ranching  - a sequencing  of  instructional  events 

fro*  proprioceptive  stimulation, 

with  tha  *,raieae  routed  to  appropriate  advanced 

or  reemdlal  material  baaed  upon  hla  answers  to 

32,  Action  Feedback  - axtaraally  displayed  cues 

diagnostic  questions  imbedded  at  lntarvala  In 

i 

inherent  In  tha  teak,  including  such  fora* 

the  material, 

i 1 

aa  instrument  Indication*  and  tha  display 

of  answer a to  questions  aa  in  Unaar 

43.  Automated  (Machine)  Adaptive  - an  automatic 

programed  instruction. 

sequencing  end  peeing  of  sventa  designed  to 

keep  e trainee  at  the  threshold  laval  of  hla 

1— 

31.  Augmented  Feedback  - Ummdlata  presentation 

ability  to  learn  at  all  tlmau. 

j V 

of  information  to  the  trains  on  boa  tha 

l ) 

results  of  hla  performance  confom  to  soma 

46.  Instructor  Selected  Sequence  - tha  ordering  of 

W 

criterion  or  an  objective  rafaranca. 

events  by  tha  Instructor,  such  aa  in  a lecture- 

recitation  period  in  tha  traditional  classroom 

3d.  Reconstruction  Feedback  - critical  analysis 

or  in  tutoring. 

*~ 

or  aval  nation  of  tralaaa  performance, 

4 1 

usually  at  tha  completion  of  an  aaarclaa 

47.  Trainaa- Initiated  Inquiry  - tha  selection, 

V y 

or  a significant  block  of  instruction. 

sequencing  and  pacing  of  learning  events  by  the 

V...  / 

trainwa. 

Contant  of  Feedback 

4B . Dynamic  Modeling  - aye  tea  programming  in  tha 

1 , 

35.  Correct  Response  Data  - an  indication  of 

form  of  a simulation  modal  which  ambles  the 

correct  refponaa  la  provided  tha  trainee 

trainaa  to  exorcise  the  modal  and  observe  the 

1 \ J 

•ithar  lMMdlataly  aftar  ha  raaponda  or 

corresponding  affects. 

automatically  in  the  avant  ho  doaa  not 

1 

respond  within  a apaciflad  time. 

INSTRUCTIONAL  SmiNC 

1 

16,  Score  Data  - tha  trainee  racaivaa 

49.  Individual  Trainee  at  Fixed  Location  - n fixed 

fa  j \ 

quantitative  information  about  hla 

study  position  for  Individual iced  instruction, 

H V ' 

parformanca  (auch  aa  amount , parcant 

such  aa  in  a school  with  carrels  or  CM 

1 *""" 

and  rata  data). 

tatminalr. 

s 

17.  Diagnostic  Data  -*  tha  trainaa  la  informad 

SO.  Individual  Trelnaaa  with  Simultaneous  Instruction 

u 

of  inadequate  parformanca,  lta  cau aa, 

at  Hiny  Locations  - any  sits  that  can  be  used 

y j \ 

and  prescribed  remedial  action*. 

with  a talwc namunl ca t Ion  mods  of  Instruction,  aa 

H \ 

with  a . Iw'dulad  radio  or  broadcaat  television. 

E • - - ‘ 

33.  System  Parformanca  Data  - tha  trainaa 

Ej 

obaarvaa  chaa«aa  in  the  stac*  of  a 

31.  Individual  Trained  with  Independent  Instruction 

fij 

eyatom  an  a consequence  of  hla  actlona 

at  Any  Location  - any  sits  that  can  ba  usad  by 

w 

in  tha  nyatam. 

a student  fur  independent  study  at  with  books 

a j ) 

or  prof.Taaand  instruction  texts. 

B V / 

Time  Schedule  for  Faadback 

E 

32.  Small  Croup  - a meeting  airs  sccoamndstlng  up 

n 

39.  .mead  lata  - iaadback  provided  la 

to  13  pacpls,  enabling  small  group  dynaaics  co 

H 

continuity  with  a trainea'a  action, 

function!  both  loada.lwta  and  leader-directed 

H 

either  continuously  ui  accrued  or  at 

groups,  a saell  classroom. 

n ( ' 

tha  conclusion  of  aach  atudwnt 

r ' 

raaponaa. 

33.  Large  Group  at  Single  Location  - a seating  aits 

□ 

for  more  than  15  people,  auch  aa  a large  c laser com 

n 

40,  Flxad  - faadback  provldad  to  tha 

or  auditorium. 

trainaa  at  praacribad  tlmas,  such  aa 

at  tha  and  of  an  aaarclaa  or  at  timed 

54.  Lirga  Groups  at  DliDeracd  Lai ’'Mona  - two  or  more 

i i j 

Lntarvala. 

group  masting  at tea  that  can  be  linked  with 

i 

communication  equipment  for  a common  training 

41.  Variable  - faadback  provided  to  a 

program,  aa  with  two-way  closed  circuit  TV 

y 

trainaa  according  to  a varlabla 

between  cleseroovm  at  two  different  ;«chooli. 

l 

schedule  which  nay  change  aa  a 

h 

function  of  a tags  of  training  or 

55.  Teem  Setting  - n aingl*  site  that  Is  equipped  to 

laval  of  perforamnoe,  This  includes 

anabli  a group  of  Individuals  to  perform  as  a 

tha  provision  f r intermittent 

team,  aa  lo  a vanpen  system  simulator  or 

preasatatlon*  to  permit  probabilistic 

operational  system. 

echadulaa  of  reinforcement . 

v 

EVENT  SEQUKMCE  LOGIC 

42.  Linear  - a flxad  sequence  of 

instruct lcnal  a vent a,  aa  in  linear 

programmed  lnatructlon  and  eotion 

pictures. 
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Form  of  Feedback: 

Action  feedback 

Content  of  Feedback: 

Correct  response  data 
Score  data 

Time  Schedule  of  Feedback: 

Immediate 

Variable 

Event  Sequence  Logic: 

Branching 

Instructional  setting: 

Individual  trainee  at  fixed  location. 


U ! 


Third,  review  the  contents  of  table  16,  Media  Pool,  and  consider 
Instructor  roles  required  for  the  use  of  these  media.  Devise  combinations 
of  media  and  Instructor  resources  that  can  carry  out  the  Intent  of  the 
algorithm  with  the  training  objectives.  List  and  describe  these  different 
combinations  as  alternative  instructional  delivery  systems. 

The  Media  Pool  is  a list  of  89  types  of  instructonal  media.  The 
list  contains  a broad  range  of  types  of  media,  including  media  in  various 
stages  of  development,  from  operational  forms  to  those  under  development, 
and  some  that  have  yet  to  reach  the  prototype  or  pilot  program  stage. 

It  is  organized  into  seven  categories.  The  categories  are  printed 
material,  audio-only  systems,  visual-only  systems,  audio-visual  systems, 
CAI/CMI,  simulated  and  operational  systems,  and  special  or  nonstandard 
items.  Within  each  category,  the  media  are  listed  alphabetically. 

While  this  is  not  an  exhaustive  list  of  types  of  instructional  media,  it 
contains  the  major  forms  being  used  or  being  considered  for  use  in 
military  training  systems. 

Fourth,  reject  those  that  fail  the  practicality  test,  described  in 
Step  2 of  the  primary  procedure. 

Conceiving  instructional  delivery  systems  using  this  alternative 
approach  is  a highly  creative  task  requiring  expert  knowledge  of  the 
subject  matter,  the  guidelines,  algorithms,  and  potential  delivery 
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i i 


systems,  as  well  as  an  awareness  of  the  local  conditions  at  the  training 
site.  It  requires  a high  level  of  professionalism  on  the  part  of  the 
training  systems  design  team. 
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TABLE  16.  MEDIA  POOL 


PRINT  MATERIALS 

CASE  STUDY  FOLDER  - A folder  of  detailed  background  Information  on  a 
problem  requiring  a decision  or  plan  of  action;  to  be  read  by  the 
trainee  prior  to  his  (1)  making  a decision  on  how  to  resolve  the 
Issue  and  (2)  participating  in  a critique  on  various  solutions. 
Various  forms  of  folders  are  used  In  support  of  such  methods  of 
instruction  as  the  Case  Study.  Incident  and  In-Basket  methods  of 
management  and  leadership  training. 

FLASH  CARDS  - A set  of  cards  designed  to  be  used  by  an  Instructor  in 
front  of  a group  of  trainees  to  drill  the  group  in  the  recall  of 
memory  type  Information. 

PRINTED  MATERIALS  - HANDOUTS  - Handouts  are  a class  of  printed  materials 
issued  to  a student  for  his  use  and  retention  to  augment  regular 
instructional  materials.  They  are  usually  instructor  prepared, 
machine  copied  materials  of  one  or  two  pages  highlighting  specific 
topics  or  updating  existing  materials. 

PRINTED  MATERIALS  - PERFORMANCE  AIDS  - Performance  aids  are  a class  of 
printed  materials  that  aid  in  job  performance  by  providing  data 
that  should  not  be  committed  to  memory.  They  include  checklist 
routines,  conversion  tables,  equipment  test  tolerance  matrices  and 
the  like. 

PRINTED  MATERIALS  - REFERENCE  BOOKS  - Reference  books  are  a class  of 
printed  materials  used  to  Identify  certain  facts  or  for  background 
information  such  as  dictionaries,  encyclopedias  or  technical 
publications. 

PRINTED  MATERIALS  - REFERENCE  CHARTS  - Reference  charts  are  a class  of 
printed  material  pictorially  displaying  data  used  to  identify 
certain  facts  or  for  background  Information.  Included  are  data 
charts,  schematic  diagrams,  topographical  maps  and  the  like. 

PRINTED  MATERIALS  - SELF-SCORING  EXERCISES  - Self-scori"  materials 
Include  exercises  and  quizzes  used  in  conjunction  wuh  standard 
curriculum,  or  programmed  Instruction.  The  class  includes  electro- 
graphic or  mark  sense  materials  scored  by  keys  or  computer,  punch 
mark  and  other  mechanical  score  indicating  equipmants,  chemically 
scored  materials,  etc.,  that  have  the  capability  of  providing  near 
immediate  student  feedback  without  the  use  of  prolonged  scoring 
procedures. 
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TABLE  16.  MEDIA  POOL  (continued) 


DIAL  ACCESS  INFORMATION  RETRIEVAL  SYSTEM  - RANDOM  AUDIO  - Dial  access 
Information  retrieval  Is  an  electronic  system  for  distributing 
audio  (and/or  visual)  materials  and  programs  which  are  stored  in  a 
location  remote  from  where  they  are  dialed  and  received.  Random 
audio  means  that  audio  materials  are  retrievable  at  any  time  by 
electronically  triggering  a tape  duplicating  machine  that  makes  a 
student  copy  from  a master  tape  within  the  library. 

DIAL  ACCESS  INFORMATION  RETRIEVAL  SYSTEM  » SCHEDULED  AUDIO  - Scheduled 
audio  means  that  audio  materials  may  be  dialed  at  any  time,  but 
once  a program  has  begun,  subsequent  users  must  join  the  program  In 
progress. 

LANGUAGE  LABORATORY  - AUDIO,  ACTIVE  - COMPARE  MODE  - An  audio  presenta- 
tional device  that  distributes  sudlo  information  via  a control 
console  to  student  stations  equipped  with  headsets,  microphone  for 
console/ Instructor-student  in ter- common 1 cation,  and  a tape  recorder. 
Student  may  Interact  with  taped  Instructional  material,  rewind  and 
play  back  or  store  responses.  Student  responses  may  be  monitored 
or  recorded  at  console. 

LANGUAGE  LABORATORY  - AUDIO  PASSIVE  MODE  - An  audio  presentational 

device  that  distributes  audio  Information  from  a control  console  to 
student  stations  equipped  with  headsets.  Audio  source  may  be  a 
phonograph  record,  a taped  recording,  or  a motion  picture  sound 
track. 

PHYSIOLOGICAL  TRAINER  (HOSTILE  ENVIRONMENT)  AUDITORY  - A training  device 
designed  to  place  controlled  stress  on  the  human  hearing  system 
through  use  of  a physiologically  and/or  psychologically  adverse 
sound  environment,  to  enable  a trainee  to  learn  to  function  in  this 
adverse  environment. 

RADIO  SYSTEM  - AM/FM  - A passive  audio  system  consisting  of  a broadcast 
studio,  transmitting  station,  and  student  radio  receivers. 

The  system  uses  designated  AM/FM  frequency  bands  for  Information 
transmission. 

RADIO  SYSTEM  WITH  RESPONDERS  - A multi-channel  two-way  radio  communication 
system  that  operates  within  UHF  or  VHF-FM  frequency  bands  limiting 
broadcast  ranges.  Network  may  be  open  or  use  encoding/decoding 
techniques  or  responders  for  individual  channel  privacy. 
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TELEPHONE  CONFERENCE  SYSTEM  - A telephone  system  with  switching  matrix 
capability  that  allows  multiple  station  two-way  audio  communication 
at  two  or  more  remote  locations. 

VISUAL  ONLY  SYSTEMS 


FILMSTRIP  PROJECTION  SYSTEM  - A single  frame  projector  or  attachment 
thereto  that  will  accept  a filmstrip  format  and  project  the  film 
Images  upon  a viewing  screen.  See:  Sound  Mlmstrlp  Projection 

System. 

MICROFORM  WITH  INFORMATION  MAPPING  - Microimagery,  such  as  microfilm, 
used  as  a medium  of  instruction  with  the  additional  requirement 
that  each  block  of  Information  be  clearly  identified  as  introduction, 
overview,  teU,  review  questions,  index  and  other  discrete  titles, 
and  that  each  type  of  Information  be  positioned  In  a standard 
location  within  the  medium  format. 

MICROFORM  WITH  INFORMATION  MAPPING  AND  ADJUNCT  EQUIPMENT  - The  theoretical 
configuration  of  a training  system  to  support  individualized 
instruction  composed  of  microimagery  in  an  information  map  format, 
a microform  reader,  and  a piece  of  auxiliary  equipment,  such  as  a 
mock-up,  which  is  the  subject  of  the  instruction. 

MOCK-UPS,  PANELS,  AND  DEMONSTRATORS  - DYNAMIC  - A visual  training  aid 
that  allows  an  instructor  to  demonstrate  manipulative  principle, 
movement  In  time  or  space,  steps  of  a procedure,  linear  effect 
within  systems  or  changes  in  condition  of  equipment  or  systems 
through  one  or  more  operating  phases. 

MODELS  AND  STATIC  MOCK-UPS  - SMALL  SCALE  - A three-dimensional  training 
aid  built  to  scale  and  representing  operational  equipment.  It  may 
be  a solid  or  cutaway  model  capable  of  disassembly  by  which  spatial 
and/or  sequential  relationships  are  represented.  Also  included  are 
layout  models,  recognition  model  sets,  and  terrain  or  topographical 
models. 

MOCK-UPS,  PANELS  AND  DEMONSTRATORS  - STATIC  - A training  aid  used  to 
demonstrate  relative  shape,  size,  composition  or  function  of  an 
object  or  system  by  a visual -cognitive  process  performed  by  the 
trainee.  Such  non-moving,  real  or  “scaled"  aids  include  cutaway 
models,  diagrams,  blow-apart  hardware  displays,  etc. 

SLIDE  PROJECTOR  SYSTEM  - 2"  X 2"  - A class  of  single  frame  picture  pro- 
jectors that  will  accept  a standard  2"  X 2"  slide  and  project  the 
contained  image  upon  a viewing  screen. 


64 


i 


► 

>o  » 1 

•9  \ 


TAEG  Report  Nc.  16 


TABLE  16.  MEDIA  POOL  (continued) 


PRINTED  MATERIAL  - WORKBOOK  - Workbooks  are  a class  of  printed  material 
used  to  augment  or  replace  Instructional  texts  by  providing  a mix 
of  text  Information  and  practice  exercises  within  a single  book  or 
manual . 

PRINTED  MATERIAL  - TEXTBOOK  - Textbooks  are  a class  of  printed  material 
dealing  with  a subject  cf  study,  Intended  for  use  at  a specified 
level  of  instruction  and  used  as  a principal  source  of  organized 
information. 

PROGRAMMED  TEXT  - BRANCHING  - A printed  text  containing  frames  of  infor- 
mation and  multiple  choice  questions  concerning  the  information., 
organized  in  such  a way  that  the  trainee's  choice  of  response 
directs  him  to  remedial  frames  or  advanced  material , as  appropriate. 

T’  • material  is  carefully  sequenced,  tested  and  revised  to  ensure 
that  a specific  student  population  will  acnieve  stated  behavioral 
objectives  with  a predetermined  level  of  success. 

PROGRAMMED  TEXT  - BRANCHING  WITH  ADJUNCT  MATERIAL/EQUIPMENT  - A form  of 

program  in  which  additional  materials  such  as  drawings,  catalogues,  or 
equipment  are  used  with  the  regular  branching  programmed  text. 

PROGRAMMED  TEXT  - LINEAR  - A printed  text  containing  a fixed  sequence  of 
small  frames  of  information  usually  in  the  form  of  questions  requiring 
the  trainee  to  construct  a simple  written  response,  which  is  immedi- 
ately evaluated.  The  material  is  carefully  sequenced,  tested,  and 
revised  to  ensure  that  a specific  student  population  will  achieve 
stated  behavioral  objectives  with  a predetermined  level  of  success. 

PROGRAMMED  TEXT  - LINEAR  WITH  ADJUNCT  MATERIAL/EQUIPMENT  - A form  of 
program  in  which  additional  material  such  as  drawings,  catalogues, 
or  equipment  are  used  with  the  regular  linear  programmed  text. 

STUDY  CARD  SETS  - A deck  or  decks  of  cards  designed  to  present  training 
information  to  an  individual  student.. 


AUDIO  ONLY  SYSTEMS 

AUDIO  DISC  PLAYBACK  SYSTEM  - An  audio  system  that  uses  a record  player 
and  sound  recorded  on  a disc  (record)  that  may  be  played  back  by  a 
listener. 

AUDIO  TAPE  SYSTEM  - An  audio  system  that  uses  a tape  recorder/ reproducer 
to  record  sound  on  magnetic  tape  that  nay  be  played  back  upon  request 
by  a listener. 
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SIMULATION  - PAPER  - The  representation  of  selected  dynamic  character- 
istics of  a system  through  the  use  of  charts,  tables,  static  photo- 
graphs, drawings,  and  lists  of  performance  characteristics  under 
specified  conditions.  This  information  is  presented  in  such  a way 
that  the  trainee  can  study  the  Initial  performance  of  the  system, 
change  inputs  to  or  elements  within  the  system  and  note  changes  in 
the  performance  of  the  system. 

TEACHING  MACHINE  - LINEAR,  STILL  VISUAL  - An  individualized  instruction 
system  composed  of  a fixed  linear  sequence  of  small  step  programmed 
instruction  frames  (still)  and  a manually  controlled  device  to 
display  the  information. 

TEACHING  MACHINE  - BRANCHING,  STILL  VISUAL  - An  individualized  instruc- 
tion system  composed  of  large  step  multiple  choice  programmed 
instruction  frames  (still)  and  a manually  controlled  device  to 
select,  sequence  and  display  program  frames  in  an  order  dependent 
upon  the  trainee's  last  response. 

AUDIO-VISUAL  SYSTEMS 


AUDIO  TAPE  WITH  PRINTED  MATERIAL  - An  audio  system  that  uses  a tape 
recorder/reproducer  to  record  sound  on  magnetic  tape  that  may  be 
played  back  upon  request.  Printed  materials  such  as  texts,  work- 
sheets, Pi,  schematics,  test  materials,  etc.,  used  with  audio  tapes 
offer  a variety  of  training  applications. 

CARREL  - AV  EQUIPPED  - A small  enclosure  or  alcove  incorporating  a desk 
used  for  individual  studies,  supplied  with  audio  and  visual  materials 
and  supporting  equipment. 

CARREL  - LABORATORY  - A small  enclosure  or  alcove  incorporating  a desk, 
to  be  used  by  one  or  two  trainees  and  equipped  with  a set  of  special 
tools  and  material  for  carrying  out  a hands-on  learning  event.  It 
may  include  audio-visual  systems. 

DIAL  ACCESS  INFORMATION  RETRIEVAL  SYSTEM  - SCHEDULED  AUDIO/VIDEO  - Dial 
access  information  retrieval  is  an  electronic  system  for  distributing 
audio  and  visual  materials  and  programs  which  are  stored  in  a loca- 
tion remote  from  where  they  are  dialed  and  received.  Scheduled 
audio/video  means  that  presentations  are  retrievable  at  any  time 
except  that  once  a program  has  begun,  subsequent  users  must  join 
the  program  in  progress. 
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FILMSTRIP  PROJECTION  SYSTEM  WITH  AUDIO  - A sound  filmstrip  projector 
represents  a family  of  audio  visual  devices  using  single  frame 
visual  filmstrips  with  sound  on  magnetic  tape  or  records.  Visuals 
and  sound  may  be  manually  or  automatically  synchronized.  Commercial 
equipment  options  include  front  or  rear  screen  projection,  remote 
and  stop  action  capability,  and  cartridge  loading  models. 

FILMSTRIP  PROJECTION  SYSTEM  WITH  AUDIO  AND  ADJUNCT  EQUIPMENT  - A system 
for  presenting  information  via  a filmstrip  projector  and  synchronized 
audio  tape  and  special  equipment  that  is  the  subject  of  study.  The 
use  of  adjunct  equipment  with  the  AV  media  provides  the  capability 
for  a variety  of  "hands-on"  training  tasks  to  be  performed. 

INSTRUCTIONAL  KIT  WITH  INSTRUCTOR  - A teaching  kit  designed  for  specific 
subject  area  instructional  support.  Kit  allows  *he  instructor  to 
use  a varied  or  multi-level  teaching  approach  to  instruction  by 
Including  appropriate  visual  aids,  audio  tapes,  models,  charts, 
demonstrators,  reference  and  test  materials. 

INSTRUCTIONAL  KITS  FOR  TRAINEES  - A modular  package  of  materials 

for  students  that  contains  all  materials  required  for  a segment  of 
instruction.  Kit  may  contain  programmed  instruction,  audio-visual 
materials,  tools,  materials,  typical  samples,  reference  materials 
and  testing  materials  as  appropriate. 

MOTION  PICTURE  PROJECTION  SYSTEM  - COMMERCIAL,  16MM  AND  SUPER  8MM  FILMS  - 
A motion  picture  projection  system  implying  the  use  of  professionally 
prepared  16mm  or  S-8mm  sound  motion  picture  films  for  training. 
Appropriate  16mm  or  S-8mm  projector  and  projection  screen  are 
incl uded. 

MOTION  PICTURE  PROJECTION  SYSTEM  - LOW  BUDGET  16MM  AND  SUPER  8MM  FILMS  - 
A motion  picture  projection  system  implying  the  use  of  locally 
produced  sound  motion  picture  films  for  training.  Such  films  are 
acceptable  for  training,  but  often  lack  the  professional  quality  of 
commercial  films.  Appropriate  16nm  or  S-Smrt  projector  and  pro- 
jection screen  are  included. 

MICROFORM  WITH  INFORMATION  MAPPING,  AND  AUDIO  - The  theoretical  configu- 
ration of  a training  system  to  support  individualized  instruction 
composed  of  microimagery  in  an  information  map  format,  a microform 
reader,  an  audio  tape  in  a cassette  and  an  audio  cassette  playback 
unit. 
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OVERHEAD  PROJECTION  SYSTEM  WITH  INSTRUCTOR  - A system  consisting  of  a 
horizontal  stage  projector  designed  to  use  a vertical  throw  for 
focusing  an  enlarged  transparency  image  upon  a projection  screen. 

An  operator  is  normally  required  to  change  the  transparency  and 
furnish  verbal  commentary. 

SOUND  SLIDE  PROJECTION  SYSTEM  - A system  for  presenting  Information  by 
means  of  an  audio  tape  and  a series  of  synchronized  projected 
visual  slides. 

STUDENT  RESPONSE  SYSTEM  - AV  SUPPORTED  - A student  feedback  response 
system  using  programmed  audio  and/or  visual  presentations.  It 
consists  of  four  major  components:  control  console  with  response 

readouts,  student  responders,  audio  visual  devices,  and  a programmer. 
Options  include  paper  tape  readouts  and  computer  Interface  terminals. 

TEACHING  MACHINE  - BRANCHING,  STILL  VISUAL  WITH  AUDIO  - An  individualized 
instruction  system  composed  of  large  step  multiple  choice  programmed 
instruction  frames  (still)  with  synchronized  sound  and  a manually 
controlled  device  to  select,  sequence  and  display  program  frames  in 
an  order  dependent  upon  the  trainee's  last  response. 

TEACHING  MACHINE  - BRANCHING,  STILL  AND  MOTION  VISUAL  WITH  AUDIO  - An 
individualized  instruction  system  composed  of  large  step  multiple 
choice  programmed  instruction  frames  (still  and  motion)  with  synchro- 
nized sound  and  a manually  controlled  device  to  select,  sequence 
and  display  program  frames  in  an  order  dependent  upon  the  trainee's 
last  response. 

TEACHING  MACHINE  - BRANCHING,  WITH  ADJUNCT  EQUIPMENT  - An  individualized 
Instruction  system  composed  of  large  step  multiple  choice  programmed 
instruction  frames  (still  or  motion  with  or  without  audio)  with  a 
manually  controlled  device  to  select  sequence  and  display  program 
frames  in  an  order  dependent  upon  the  trainee's  last  response. 
Associated  with  this  equipment  is  a second  piece  of  equipment,  such 
as  a mock-up,  which  is  the  subject  of  instruction  and  is  operated 
according  to  instructions  from  the  basic  teaching  machine. 

TEACHING  MACHINE  - LINEAR,  STILL  VISUAL  WITH  AUDIO  - An  individualized 
instruction  system  composed  of  a fixed  linear  sequence  of  small 
step  programmed  instruction  frames  (still  and  motion)  with  synchro- 
nized audio,  and  a manually  controlled  device  to  display  the  audio 
and  visual  information. 
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TELECONFERENCE  SYSTEM  - A telecommunication  system  that  allows  audio  and 
visual  two-way  conuum  1 cat Ion  between  two  or  more  renote  locations. 

TELEVISION  - CABLE  (CATV)  - A hybrid  CCTV  system  offering  selective, 
multiple  channel,  encoded  programming  to  cable  network  patrons.  A 
typical  system  consists  of  a signal  receiving  antenna  system  for 
the  master  station  and  relay  of  amplified  signal  channels  via  area 
substations  to  system  subscribers.  Programming  may  also  be  generated 
and  transmitted  between  substations  offering  multiple  options  for 
conference  or  training.  Programs  are  encoded  for  privacy  and  control 
of  viewing  audience. 

TELEVISION  - CARTRIDGE  (CTV)  - A cartridge  television  system  (CTV) 

consists  of  packaged  video  tape  programs,  video  recorder,  playback 
and  display  units,  and  control  equipment  offering  high  selectivity 
and  availability  for  individualized  programming.  Program  cartridges 
may  be  prerecorded,  locally  produced,  or  recorded  off-the-air. 

TELEVISION  - CLOSED  CIRCUIT  (CCTV)  WITHOUT  FEEDBACK  - CCTV  without 

feedback  is  an  electronic  transmission  system  for  images  and  sound 
using  a coaxial  cable  distribution  system.  System  design  Includes 
one  or  more  studios  or  control  rooms,  a signal  distribution  center, 
and  signal  distribution  cables  terminating  in  reception  areas 
equipped  with  receiver/monitors.  Off  air,  live  or  video  taped 
programs  may  be  used. 

TELEVISION  - CCTV  WITH  FEEDBACK  - CC1V  with  feedback  is  the  transmission 
of  a live  presentation  with  audio  feedback  via  microphone  or  tele- 
phone in  each  receiving  classroom.  Live  instructor  is  required  in 
student-instructor-CCTV  loop  to  activate  the  feedback  node. 

TELEVISION  - NON-MAGNETIC  VIDEO  DISC  SYSTEM  - An  experimental  form  of 
television,  similar  in  function  to  cartridge  television,  in  which 
the  program  Is  encoded  on  a thin  plastic  disc,  distributed  to  users 
where  it  is  rotated  at  high  revolutions  per  minute  on  a player  which 
roads  the  data  and  sends  program  signals  into  the  ant. anna  terminals 
of  a standard  color  television  receiver.  Random  access  capability. 

TELEVISION  - OPEN  BROADCAST  - Open  broadcast  television  is  the  elect'  >nic 
transmission  of  images  with  accompanying  sound  from  a single  channel 
VHF  and  UHF  station  and  shorter  range  multiple  channel  2500  MHZ 
systems. 
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TELEVISION  - PORTABLE  VIDEO  TAPE  SYSTEM  - A low  cost  video  tape  recording 
and  playback  system  which  is  self-contained  and  portable.  Typical 
systems  consist  of  one  or  two  mobile  vidicon  cameras!  a small  scan 
video  tape  recorder  and  a monitor  receiver.  Immediate  area 
programming  and  open  broadcast  reception  and  recording  is  standard. 

TELEVISION  - VIDEO  DISC  WITH  ADJUNCT  EQUIPMENT  - A theoretical  con- 
figuration of  a video  disc  system  In  which  random  access  capabilities 
are  used  by  a trainee  in  retrieving  step-by-step  procedures  and 
diagnostic  routines  as  an  aid  in  performing  these  operations  on  a 
piece  of  equipment. 

CAI/CMI 


COMPUTER  ASSISTED  INSTRUCTION  (CAI)  - A form  of  individualized  instruction 
that  employs  digital  computer  technology  to  manage  and  display 
information  to  a student,  accept  student  responses,  provide  knowl- 
edge of  results,  and  select  subsequent  learning  event. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV  BASIC  CONFIGURATION  - An 

individualized  computer  based  teaching  system  being  developed  by 
the  University  of  Illinois  at  Urbana-Champaign,  and  includes  up  to 
4096  terminals,  a communication  network,  a central  computer  and  the 
author  language  TUTOR. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV,  BASIC  CONFIGURATION  AND  AUDIO  - 
System  includes  basic  configuration  of  PLATO  IV  plus  a random  access 
audio  playback  system. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV,  BASIC  CONFIGURATION  WITH  ADJUNCT 

EQUIPMENT  - Includes  the  basic  terminal  with  externally  connected 
auxiliary  equipment. 

COMPUTER  ASSISTED  INSTRUCTION  - PLATO  IV  BASIC  CONFIGURATION  WITH  ADJUNCT 

EQUIPMENT  AND  AUDIO  - The  basic  terminal  with  externally  connected 

auxiliary  equipment  including  a random  access  audio  playback  system. 

COMPUTER  ASSISTED  INSTRUCTION  (CAI/CMI)  TICCIT  - A CAI  system  designed 
by  Mitre  Corporation  which  allows  the  student  to  manage  his  own 
instruction. 

COMPUTER  MANAGED  INSTRUCTION  (CMI)  - A student  management  system  in 
which  a computer  receives  information  about  student  achievement 
from  terminals  on-  or  off-line  and  directs  the  student  to  a sequence 
of  off-line  learning  modules  suited  to  the  student’s  style  of 
learning  and  level  of  achievement. 
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SIMULATED  AND  OPERATIONAL  SYSTEMS 

COMPUTER  SIMULATION  - ON-LINE  - A trainee  station  equipped  with  a 

computer  terminal  In  which  the  trainee  operates  in  direct  Interface 
with  the  computer  as  part  of  the  program  loop.  By  his  inputs,  the 
trainee  determines  his  allowable  performance  parameters  and  discerns 
the  effect  of  his  Inputs  upon  the  system  being  simulated, 

COMPUTER  SIMULATION  - OFF-LINE  - A trainee  station  equipped  with  a 

computer  terminal  enabling  a trainee  to  select  a computer  simulation 
program,  enter  his  own  variables  (batch  processing)  end  run  the 
simulation  to  determine  the  performance  of  the  simulated  system 
under  a variety  of  conditions* 

GAME  - COMPUTER  SUPPORTED  SIMULATION  - Any  contest,  governed  by  rules, 
between  teams  or  Individuals,  where  the  contest  Is  a dynamic  model 
of  some  real  system,  and  a computer  is  used  in  performing  some  of 
the  calculations  necessary  for  the  operation  of  the  mode*  as  in 
computer  supported  war  gaming. 

GAME  - MANUAL  SIMULATION  - Any  contest  between  teams  or  individual 

players,  governed  by  rules,  where  the  contest  Is  a dynamic  model  of 
some  real  system,  and  Is  played  without  the  aid  of  a computer. 

LOGIC  TRAINERS  - A class  of  trainers  that  synthetically  allow  electronic, 
mechanical,  fluid  or  gaseous  conceptual  system  logic  training 
without  the  use  of  actual  hardware. 

GAME  - COMPUTER  SIMULATION,  SOLITAIRE,  WITH  VISUAL  DISPLAY  - Any  contest, 
governed  by  rules,  between  a single  player  and  a computer  with 
visual  attachments  where  the  contest  is  a dynamic  model  of  some 
real  world  system  or  event. 

OPERATIONAL  EQUIPMENT  WITH  MANUALS  - A unit  of  operational  equipment 

being  used  for  Instructional  or  training  purposes  with  its  supporting 
technical  documentation  such  as  operator's  guides,  maintenance 
manuals  and  parts  lists.  May  be  an  electronic  black  box,  rifle,  or 
truck. 

OPERATIONAL  SYSTEM  - REAL  ENVIRONMENT  - An  operational  system  used  for 
training  such  as  an  aircraft,  ship  or  track  vehicle.  Part  task, 
full  task,  sub-team,  team  or  multi-team  training  may  be  conducted 
in  conjunction  with  or  independent  of  normal  operations. 
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OPERATIONAL  SYSTEM  - SYNTHETICALLY  STIMULATED  - An  operational  system 
that  Is  used  for  training  by  Interfacing  Input  equipments  In  the 
form  of  tapes,  black  boxes,  or  computers.  Such  Input  equipments 
present  programed  data  to  the  operational  system  allowing  It  to 
be  used  for  training  or  \evaluat1ve  purposes.  May  be  used  for  part 
task,  full  task,  sub-team,  multi-team  training  or  combinations 
thereof.  \ 

PHYSIOLOGICAL  TRAINER  (HOSTILE',  ENVIRONMENT)  VISUAL  - A training  device 
designed  to  place  controlled  stress  on  the  human  visual  system, 
through  the  use  of  physiologically  and/or  psychologically  adverse 
or  low  threshold  visual  slgnails,  to  enable  a trainee  to  learn  to 
function  in  this  adverse  environment. 

PHYSIOLOGICAL  TRAINER  (HOSTILE  ENVIRONMENT)  SURFACE  AND  INTERNAL  SENSES 
A broad  category  of  training  devices  designed  to  provide  the 
cutaneous,  kinesthetic  and  ofl factory  sensors  with  physiologically 
and/or  psychologically  adverse  signals,  to  enable  a trainee  to 
function  in  adverse  pressure, \ temperature,  pain  or  disorientating 
motion  envlro  iments.  \ 


An  operational  system 


PROCEDURE  TRAINER  - Training  hardware  designed  for  basic,  training, 
familiarization  or  transition  type  procedure  training  for  normal, 
alternate  and  emergency  operation  of  operational  hardware.  Trainer 
systems  respond  with  a lesser  degree  of  fidelity  of  performance 
than  Is  required  for  simulators^  May  be  used  for  various  combinations 
of  part  task,  full  task,  sub-tea^m,  team  or  multi-team  training. 

PROCEDURE  TRAINER  - ADJUNCT  DISPLAYS  AND  LOGIC  - Training  hardware 
designed  for  basic  training,  familiarization  or  transition  type 
procedure  training  for  normal,  alternate  and  emergency  operation 
of  operational  hardware.  Trainer V systems  respond  appropriately 
to  trainee  inputs  but  to  a lesser  degree  of  fidelity  of  performance 
than  is  required  for  simulators.  May  be  used  for  various  combinations 
of  part  task,  full  task,  sub-team,  'team  or  multi-team  training. 

Adjunct  displays  and  logics  may  include  scoring  attachments, 
adaptive  control,  automatic  demonstrations,  enhanced  displays, 
automated  briefing  and  debriefing  capability,  automatic,  coaching* 
remedial  exercise  prescriptions  or  follow-on  assignments. 

SIMULATOR  - Training  hardware  that  is  designed  specifically  for  training 
purposes  to  simulate  operational  equipment/ systems  or  portions 
thereof,  and  which  simulates  the  operational  environment  in  a 
training  situation.  When  operated,  it  becomes  a dynamic  model  of 
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the  appearance  and  performance  of  selected  aspects  of  the  opera- 
tional equipment/ system.  May  be  designed  for  part  task,  full  task, 
sub-team,  team,  multi-team  training  or  combinations  thereof. 

SIMULATOR  - ADJUNCT  DISPLAYS  AND  LOGIC  - Training  hardware  that  is 

designed  specifically  for  training  purposes  to  simulate  operational 
equipment/systems  or  portions  thereof,  and  which  simulates  the 
operational  environment  In  a training  situation.  When  operated, 
it  becomes  a dynamic  model  of  the  appearance  and  performance  of 
selected  aspects  of  the  operational  equipment/ system.  May  be 
designed  for  part  task,  ful1  task,  sub-team,  team,  multi-team 
training  or  combinations  thereof.  Adjunct  displays  and  logics 
may  Include  scoring  attachments,  adaptive  control,  automatic 
demonstrations,  enhanced  displays,  automated  briefing  and  debriefing 
capability,  automatic  coaching,  remedial  exercise  prescriptions 
or  follow-on  assignments. 

SPECIAL  AND  NON-STANDARD  ITEMS 

AUTOMATIC  RATERS  - INFORMAL  TRAINING  - A class  of  electromechanical 
response  rating  devices  used  primarily  for  informal  refresher 
type  training.  Typically,  a gaming  approach  Is  used  to  offer 
multiple  choice  type  questions  to  the  trainee.  Immediate  feedback 
upon  answer  choice  selection  is  given  in  the  form  of  right,  wrong, 
or  item  score  as  well  as  cumulative  score. 

CARREL  - DRY  - A small  enclosure  or  alcove  incorporating  a desk,  used 

for  individual  studies,  without  audio-visual  or  laboratory  equipment, 

CLASSROOM  - TRADITIONAL  - A classroom  designed  and  equipped  for  an 
instructor  to  lecture,  lead  group  discussions,  conduct  paper  and 
pencil  tests  and  use  instructor  controlled  audio-visual  aids. 

DO-IT-YOURSELF  KITS  - A type  of  instructional  kit  containing  instructions 
and  materials  for  fabricating  a usable  product.  Such  a kit  offers 
practical  "hands-on"  training  following  theoretical  training. 

GAME  - MANUAL  NON -SIMULATION  - Any  contest  between  teams  of  individual 
players,  governed  by  rules,  where  the  contest  is  not  a dynamic  model 
of  some  real  system,  and  is  played  without  the  aid  of  a computer. 

SPECIMEN  SETS  - An  instructional  kit  containing  samples  of  similar  items, 
liquids  or  materials  that  may  be  tested  or  evaluated  for  identifi- 
cation, quality  or  type. 
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APPENDIX  B 

COST  MODEL:  DISCUSSION,  ASSUMPTIONS  AND  LIMITATIONS 

An  economic  analysis  Is  a critical  step  in  the  design  of  training 
systems.  A rational  choice  of  an  instructional  delivery  system  cannot 
be  based  upon  training  effectiveness  without  regard  to  cost  and  vice 
versa.  In  order  to  facilitate  the  economic  analysis  of  instructional 
systems,  a cost  model  has  been  constructed.  The  model  Is  simply  a 
computational  algorithm  for  determining  both  the  cost  of  the  components 
and  the  total  Instructional  delivery  system. 

An  economic  analysis  requires  that  alternatives  be  identified  ana 
associated  resources  specified.  These  determinations  must  be  made  prior 
to  the  use  of  the  cost  model  and  constitute  the  Input  data  for  the 
model.  The  TECEP  approach  outlined  above  provides  a systematic  procedure 
for  the  Identification  of  feasible  training  systems  and  associated 
resource  requirements.  After  alternatives  have  been  identified  and 
their  resource  requirements  specified  they  must  be  "costed"  and  time 
phased.  The  most  common  method  of  costing  is  to  place  dollar  values  on 
the  resources.  These  values  can  be  time  phased,  discounted  and  summed 
to  represent  the  present  cost  of  each  alternative. 

The  assumptions  and  objectives  underlying  the  comparative  costing 
of  proposed  media  sets  determines  which  resources  are  relevant  and  how 
these  resources  are  valued.  The  interpretation  of  the  output  of  the 
cost  model  is  dependent  upon  these  assumptions  and  objectives.  For 
certain  objectives  the  outputs  have  only  relative  meaning  while  for 
other  applications  the  outputs  could  have  absolute  meaning. 

When  the  objective  of  the  analysis  is  to  select  the  most  efficient 
alternative  from  among  a specified  set,  all  of  which  are  capable  of 
meeting  the  training  objectives,  then  the  resources  common  to  all  alterna- 
tives can  be  factored  out  and  ignored  in  the  analysis.  When  the  objective 
is  to  determine  the  total  absolute  long-run  cost  cf  training,  then  all 
resources  used  for  training  must  be  included  and  evaluated  at  their 
opportunity  cost.  When  the  objective  is  to  determine  the  budget  require- 
ments to  implement  and  operate  a system,  then  the  cost  of  resources 
which  must  be  acquired  plus  the  current  costs  of  operation  are  the 
relevant  costs. 

in  the  use  of  the  following  cost  model,  the  objectives  of  t.he 
analysis  must  be  clearly  specified  and  resources  identified  and  priced 
accordingly.  A meaningful  economic  analysis  requires  that  alternatives 
be  available,  one  of  which  may  be  the  status  quo.  By  making  explicit 
all  of  the  alternatives  and  their  resource  requirements,  the  analysis 
can  often  be  greatly  simplified.  Resources  which  are  common  to  all 
alternatives  and  difficult  to  evaluate  can  be  factored  out  of  the 
analysis. 
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Resources  which  are  factored  out  are.  nevertheless,  a part  of  the 
total  long-run  cost  of  training.  If  the  decision  to  undertake  training 
Is  contingent  upon  the  benefits  to  be  acquired  versus  total  training 
costs,  then  these  resources  must  be  evaluated  and  the  total  cost  weighed 
against  the  benefits  accruing  from  the  training. 

Most  military  tasks  have  become  so  sophisticated  that  the  need  for 
training  is  axiomatic.  Often  the  pertinent  question  Is  how  best  to  do 
the  training  and  not  whether  or  not  to  do  the  training.  When  the 
decision  Is  already  made  to  undertake  the  training  to  achieve  a particular 
proficiency  level  then  the  benefits  of  any  particular  alternative  over 
another  can  be  measured  with  respect  to  the  next  most  efficient  alter- 
native. Relative  or  incremental  costing  of  alternatives  provides 
sufficient  information  for  selection  of  the  more  efficient  alternatives. 

It  Is  anticipated  that  many  users  of  the  TECEP  approach  and  the 
cost  model  will  be  administrators  at  the  operational  level.  These 
Individuals  most  often  encounter  problems  of  how  best  to  provide  a given 
level  and  quantity  of  training.  They  seldom  have  an  opportunity  to 
control  these  variables.  Administrators  at  this  level  are  most  often 
faced  with  cost  minimization  problems  and  are  primarily  interested  in 
planning  their  training  system  to  most  efficiently  accomplish  their 
training  goals.  They  often  have  little  need  to  determine  the  value  or 
worth  of  training  and,  hence,  have  little  need  to  compute  a benefit-cost 
ratio. 

While  the  emphasis  of  the  TECEP  approach  Is  on  cost  minimization 
(fixed  output  levels)  there  will  be  requirements  for  analysis  in  which 
benefits  fluctuate  In  response  to  training  approaches.  The  evaluation 
of  differential  benefits  accruing  from  different  training  approaches  Is 
a complex  problem  and  one  which  has  been  beyond  the  objectives  of  this 
model.  While  the  cost  model  can  be  used  to  evaluate  the  resources 
required  for  various  training  approaches.  It  does  not,  nor  was  It  Intended 
to,  provide  a method  of  assessing  differential  benefits  or  effects  of 
alternative  training  approaches. 

The  basic  output  of  the  cost  model  is  the  present  value  (cost)  of 
each  alternative.  Additional  arithmetical  computations  are  presented. 

The  latter  Include  the  total  and  average  annual  cost  per  student  position, 
the  average  cost  per  graduate  and  a distribution  of  the  incidence  of 
costs  over  the  life  of  the  alternative  being  evaluated. 

For  most  applications  of  the  model,  the  analysts  will  be  required 
to  access  multiple  data  sources.  Past  records  of  operational  units 
provide  one  valuable  data  source.  Personnel  data  published  by  NAVPERS, 
and  other  similar  types  of  data  can  be  used  for  estimates  of  personnel 
costs.  While  the  model  requires  rather  detailed  breakdown  of  certain 
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data,  the  model  can  be  used  to  advantage  even  when  many  of  these  data 
are  not  highly  reliable.  However,  data  reliability  must  be  recognized 
in  the  Interpretation  of  results. 

There  are  numerous  limitations  In  the  use  of  the  model.  First,  and 
perhaps  most  significant,  the  model  is  not  capable  of  Identifying  or 
selecting  (from  among  the  feasible  set)  the  most  efficient  media.  The 
model  does  not  utilize  any  optimization  criteria  for  ascertaining 
effectiveness  or  efficiency.  Its  use  is  limited  to  a cost  determination 
of  proposed  alternatives  (media  sets)  and  only  through  an  iterative  use 
of  the  model  could  one  hope  to  move  toward  more  efficient  solutions. 
Furthermore,  the  model  is  not  designed  to  predict  or  forecast  the  total 
cost  of  a system  for  which  a planner  must  budget  resources.  Its  primary 
purpose  is  to  aid  in  selecting  the  most  efficient  instructional  medium. 

Second,  the  model  is  constructed  upon  the  assumption  that  for  any 
specified  planning  period  there  will  be  some  resources  which  must  be 
used  as  they  exist  and  others  which  can  be  varied  to  accommodate  various 
training  numbers  and  levels.  However,  there  is  both  an  absolute  limit 
and  an  efficient  limit  to  the  amount  of  variable  resources  which  can  be 
expanded  against  a fixed  set  of  resources  and  one  must  be  cognizant  of 
these  limitations  in  the  use  of  the  model, 

A basic  computational  unit  for  which  many  of  the  variable  costs  are 
entered  in  the  model  is  the  "student  position."'0  The  number  of  student 
positions  required,  and  hence  the  variable  resources,  are  computed  as  a 
function  of  the  training  requirements.  The  training  requirements  are 
exogenously  determined  and  reflect  both  numbers  trained  and  course 
characteristics. 

Changes  in  educational  technology  which  have  the  effect  of  reducing 
the  time  required  in  the  media  may  result  in  the  need  for  fewer  student 
positions  and  lower  numbers  of  students  in  training  to  fulfill  training 
requirements.  These  cost  savings  would  be  reflected  in  the  model.  The 
impact  of  introducing  educational  technology  which  has  no  effect  on  the 
resource  requirements  or  time  spent  in  training  cannot  be  evaluated  with 
this  cost  model.  The  model  is  not  designed  to  evaluate  the  effects  of 
introducing  technology  In  which  the  impact  occurs  entirely  on  the  benefit 
side. 


A student  position  may  be  a carrel  and  related  instructional  material, 
a classroom  position  and  related  equipment,  a flight  simulator,  or  it 
might  be  uniquely  defined  in  terms  of  the  system  being  analyzed. 
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Third,  the  model  assumes  all  variable  cost  functions  are  linear— an 
assumption  that  may  not  be  tenable  for  specific  training  situations. 

Fourth,  the  model  does  not  provide  any  means  for  evaluation  of 
secondary,  or  spillover,  effects  of  alternative  training  approaches 
These  effects  are  Implicitly  assumed  to  be  constant  (or  equal)  for 
alternatives  considered.  If  such  effects  do  in  fact  exist,  they  must  be 
evaluated  outside  the  model.  A general  model  cannot  be  defined  in 
sufficient  detail  to  cover  all  possible  contingencies.  These  contingenci 
may  require  the  user  to  exercise  judgment  in  his  interpretation  of  input 
variables.  The  important  consideration  is  that  all  relevant  costs  be 
included  and  that  data  are  entered  in  the  input  variables  In  a manner 
which  avoids  double  counting. 

The  user  may  often  find  it  convenient  to  redefine  certain  variables 
in  order  to  reduce  the  complexity  of  the  input  data  for  specific  applica- 
tions. Such  changes  can  be  made  by  identifying  the  relevant  functional 
relationships  in  the  FORTRAN  program  and  making  changes  in  these  relation 
ships  where  necessary. 

If  the  analyst  is  willing  to  make  certain  assumptions  about  the 
structure  of  the  cost  data  at  various  points  throughout  the  model,  then 
a number  of  the  input  variables  are  not  relevant  and  can  be  entered  as 
zero.  For  example,  if  the  Instructional  material  is  developed  prior  to 
implementation  and  no  further  development  is  undertaken  during  the 
planning  period  then  the  variable  concerning  the  dollars  required  for 
instructional  material  development  is  zero  for  all  years  in  the  planning 
period.  Similarly,  if  it  can  be  assumed  that  the  Instructional  material 
has  no  remaining  value  at  the  end  of  the  planning  period,  then  the 
variable  concerning  the  remaining  value  of  instructional  materials  is 
equal  to  zero.  A willingness  to  eliminate  many  of  these  factors  by 
assumption  would  enable  the  analysts  to  reduce  the  complexity  of  the 
input  data. 

An  effort  was  made  in  constructing  the  model  to  gain  as  much  flexi- 
bility as  possible,  yet  not  at  the  expense  of  eliminating  the  model 
usefulness  for  analysis  of  less  complex  problems. 


11  Secondary  effects  are  those  effects  which  occur  outside  the  influence 
of  the  decision-making  unit.  Therefore,  the  decision  maker  does  not 
normally  consider  the  impact  of  secondary  effects  when  making  his 
decision.  However,  from  a societal  viewpoint  these  effects  may  be 
extremely  Important.  An  example  of  a secondary  effect,  and  one  not 
normally  considered  in  evaluating  military  training,  is  the  worth  of 
the  training  to  the  individual  in  preparing  him  for  a civilian 
occupation. 


YALG  Report  Mo.  16 


The  Input  variables  are  classified  Into  seven  classes  as  follows: 
(11  facilities,  (2)  equipment,  (3)  Instructional  material  development, 
(4)  personnel,  (5)  students,  (6)  supplies,  and  (7)  miscellaneous.  A 
definition  of  each  variable  follows: 


1 . Facilities 
FACOST 

LOFFA 
CPSQFT ( I ) 


SQFTIN 

SQFTST 

SQFTAM 

2.  Equipment 
EQCISP 


L0FEQ1 

CAQSP(I) 


LOFEQ(i) 


Total  costs  of  facilities  acquisition 
and  refurbishing  which  are  necessary 
fcr  implementation. 

Expected  .years  of  life  of  FACOST  assets. 

The  annual  cost  of  operation  and  maintenance 
of  facilities  per  square  foot  (Includes 
operation,  maintenance,  janitorial  service, 
utilities,  etc.).  Include  the  annual 
opportunity  costs  of  facilities  where  applicable. 

Total  square  feet  required  for  each  instructor. 

Total  square  feet  required  per  student  position. 

\ 

Total  square  feet  required  for  administrative', 
overhead.  ^ 

\ 

The  cost  of  equipment  necessary  for  implementa-  \ 
tion  (that  which  is  not  dependent  on  the  number  ' 
of  student  positions).  Do  not  include  equipment 
which  is  uniquely  associated  with  student 
positions  (i.e.,  costs  Included  in  variable 
EQIMPC) . 

The  expected  years  of  life  of  equipment  included 
in  EQCISP. 

Total  cost  of  equipment  to  be  acquired  in  each 
year  of  planning  period  following  implementation. 
Include  cost  of  equipment  which  represents 
expansion  or  addition  to  the  program  plus 
replacement  costs  for  that  equipment  included 
in  EQCISP. 

The  expected  years  of  life  of  equipment  which 
has  been  Included  in  CAQSP(I). 
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OMFEQ(I) 

EQIMPC 

LOFEQ 

COPMT(I) 

TSPOSD 

3.  Instructional 
UIMD 

UIMDYR(I) 


Total  annual  operation  and  maintenance  cost  of 
fixed  equipment;  i.e.,  tb;  operation  and  mainte- 
nance cost  of  equipment  not  uniquely  related  to 
student  positions.  O&M  costs  of  equioment 
included  in  variable  EQCISP  and  CAQSP(I). 

The  cos;  of  equipment  (per  student  position) 
which  must  be  acquired  for  implementation.  Do 
not  include  equipment  which  is  not  uniquely 
related  to  student  positions  (i.e.,  do  not 
include  equipment  costs  included  in  variable 
EQCISP) . 

The  expected  years  of  life  of  student  position 
equipment;  i.e.,  equipment  included  in  EQIMPC. 

Annual  operation,  maintenance,  and  replacement 
costs  of  equipme*  •„  associated  with  each  student 
position  in  each  year  of  the  planning  period; 
i.e.,  the  O&M  costs  of  equipment  included  in 
variable  EQIMPC  and  the  replacement  costs  of 
any  student  position  related  equipment. 

The  percentage  of  planned  operating  time  the 
student  position  equipment  is  nonfunctional 
because  of  unplanned  contingencies;  i.e., 
equipment  failure,  weather,  etc.  (percentage  of 
down  time  equals  one  minus  the  percentage 
availability). 

Material  Development 

The  percentage  of  time  spent  in  the  training 
medium  (for  the  nonrecycled  student)  for  which 
unique  hours  of  instructional  material  must  be 
developed. 

The  number  of  unique  hours  of  new  instructional 
material  to  be  developed  in  each  year  of  the 
planning  period.  (The  model  assumes  that  any 
materiel  developed  and  reflected  in  this  variable 
is  unique  to  the  course  e no  will  be  fully 
depreciated  at  the  end  of  the  planning  period.) 
This  variable  does  not  include  any  updating  of 
original  course  material . 
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UPDATE 

Update  factor  for  instructional  material. 
Percentage  of  the  original  development  of 
instructional  material  expended  each  year  to 
maintain  the  courseware. 

EVIM 

The  percentage  of  the  original  development  cost 
of  the  instructional  material  which  remains  at 
the  end  of  the  planning  period. 

CIMD 

Average  cost  of  developing  the  master  copy  for 
one  hour  of  instruction  (i.e. , the  per  unit 
instructional  materia!  development  costs). 

Personnel 

INTSPO 

Instructor-tc-student  position  ratio. 

SAL  I NR 

Average  annual  salary  and  benefits 
for  one  instructor. 

Supplies 

SUPPLY 

Average  cost  of  expendable  supplies  per  student 
while  in  the  training  medium. 

Students 

GRAD(I) 

rhe  number  of  students  who  must  be  trained  for 
each  year  of  the  planning  period;  i.e.,  the 
number  who  must  complete  the  program  and  graduate. 

STUDSL 

Average  annual  salary  and  benefits  for  one 
student. 

STCST1 

Average  student  travel  costs  to  and  from  school . 
Do  not  include  any  travel  done  as  part  of  the 
course. 

STCST2 

Average  student  travel  costs  which  a 3 incurred 
as  part  of  the  course.  Do  not  include  any 
costs  to  and  from  school . 

7 . Miscellaneous 

N The  number  of  years  in  the  planning  period. 

(In  setting  the  planning  period,  guidance  can 
be  found  in  SECNAVINST  7000. 14A,  pages  7 8 8.) 
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ARATE 

The  attrition  rate.  The  percentage  of 
students  who  enroll  in  the  program  but  never 
complete  the  training. 

DRATE 

The  discount  rate  (10  percent  according  to 
DoD  Instruction  7041.3). 

WSCHOP 

The  time  in  weeks  the  student  position  is 
available  per  year. 

TLENGH 

The  average  time  In  weeks  spent  in  the  training 
medium  for  the  nonrecycled  student. 

TLEGTH 

The  average  hours  per  week  the  student  spends 
in  the  medium. 

RCRATE 

Recycle  rate  equals  the  percentage  of  students 
enrolling  in  the  training  who  will  repeat  some 
part  of  the  program. 

ARCYTM 

Average  recycle  time  in  weeks  equals  the 
average  amount  of  time  a student  spends  in 
repeating  any  and  all  parts  of  the  course. 

ESP 

The  percentage  of  student  positions  above  the 
computed  number  which  are  to  be  acquired  to 
provide  for  fluctuations  in  student  inputs 
through  the  system. 

The  following  variables  are  computed  by  the  model  from  the  above 
input  data: 


1 . Facilities 
TSQFT 

FCOST(I) 

2.  Equipment 
NSPR(I) 


Total  square  feet  of  facilities  required: 

T$QFT= (SQFTST ) (PSP )+ ( INTSPO) (PSP ) (SQFT IN )+SQFTAM . 

Total  cost  of  facilities  for  each  year  of 
the  planning  period: 

FCOST ( I )= (TSQFT) (CPSQFT(I ) ) . 


Number  of  student  positions  required  for  the 
system: 
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NSRR( I )»( (SMWRRC( I )+STUDMM( I ) )/ (HSCHOP )/ (1 -TSOPSD) . 

MfiSP  Mean  number  of  student  positions  for  planning 

period: 


MNSP=  ^2NSPR(I)/N. 

PSP  Planned  number  of  student  positions: 

PSP=MNSP+(ESP ) (MNSP ) . 

EAQCI  Equipment  acquisition  costs  necessary  for 

implementation: 

EAQCI=(EQIMPC)(PSP)+(EQCISP). 

TAEQC(I)  Total  annual  operation,  maintenance  and  equipment 

acquisition  costs  for  each  year  of  the  planning 
period: 

TAEQC( I } =(CAQSP ( 1 )+ ( C0PMT( I ) ) (PSP )+0NF£Q (I). 

E3  Annual  depreciation  of  student  position  equip- 

ment : 

E3  = (EQIMPC) (PSP)/L0FEQ. 

R Internal  computed  variable  indicating  the  years 

of  life  remaining  in  equipment  at  end  of  plan- 
ning period. 

RVEQ  Remaining  value  of  student  position  equipment 

at  end  of  planning  period: 

rveq=(r)(e3). 

RVEQ2  Remaining  value  of  equipment  purchased  in  each 

year  of  planning  period  (-  for  all 
(LOFEQ(I)  -N)Z0): 

N 

RVEQ2=£(L0FEQ(I)-N)  * ( CAQSP ( I ) /LOFEQ ( I ) ) . 

1=1 
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RVEQ3  Remaining  value  of  equipment  purchased  for  i 

implementation  (-for  all  (LOFEQl-N)B  0): 

RVEQ3  - (L0FEQ1-N)  * EQCISP/LOFEQ1 . j 

3.  Instructional  Material 

ACIMO  Instructional  material  development  costs  for  v ) 

implementation: 

ACIMOS(CIMO) (UIMD) (TLEGTH) (TLENGH) . 

CUIMD(I)  Total  cost  of  developing  instructional  material 

in  each  year  of  planning  period: 

\ * 

CUIMD(I )a(CIMD) (UIMDYR(I )) . 

AIMMC(I)  Maintenance  costs  of  Instructional  material  for  H J 

each  year  of  planning  period: 

AIMMC(I )aCUIMD( I )+ (AC IMD) (UPDATE) . ) 

RVIM  Remaining  value  of  instructional  material  at 

end  of  planning  period: 

RVIM=(ACIMD)(EVIM) . 

4.  Personnel  » 

RINSTR  Number  of  Instructors  required: 

RINSTR={ INTSPO) (PSP ) . 

CINSTR(I)  Total  costs  of  salary  and  benefits  for  all 

Instructors  for  each  year  of  planning  period: 

CINSTR(I  HSALINR)  (RINSTR) . 

5.  Students 

STUD(I)  Student  inputs  necessary  in  each  year  to  provide 

the  required  number  of  graduates: 

STUD(I )SGRAD(I }/(l-ARATE). 
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AAS1N 


STUDMW(I) 


SMWRRC(I) 

AOB(I) 

AAOB 


TRAVEL 

SSALRY ( I ) 

6.  Supplies 
SUPPY(I) 


Average  annual  student  Inputs  required  to  provide 
the  number  of  graduates  specified  In  each  year: 

AASIN*ZlSTUD(I)/N. 

1=1 

Total  time  required  In  training  for  all  students 
In  each  year  of  planning  period  to  train  the 
required  number  of  students  (to  specified 
objectives)  utilizing  the  media  set  under 
consideration  (exclude  recycle  time): 

STUDMW( I )■ (TLENGH) (STUD( I ) ) (1  - . 5 (ARATE ) ) . 

Total  time  required  for  recycling  for  all 
students  in  each  year  of  planning  period: 

SMWRRC( I)=( RCRATE ) (STUD( I ) ) (ARCYTM) . 

Average  number  of  students  on  board  for  each 
year: 

A0B(I  HSMWRRC(I  )+STUDMW(  I ) )/WSCH0P . 

Mean  number  of  students  on  board  for  entire 
planning  period: 


AA0B=Z  A0B(I  )/N. 
1=1 


Total  annual  travel  costs  for  all  students: 

TRAVEL = ( AAS I N ) ( STCST 1 ) + ( STCST2 ) ( AAS I N ) 

(1-0.5  ARATE). 

Total  costs  of  student, salary  and  benefits  for 
all  students  for  each  year  of  planning  period: 

SSALRY ( I ) = ( (SMWRRC ( I J+STUDMW ( I ) ) / 52 ) ( STUDSL ) . 


Total  cost  of  student  supplies  for  each  year 
in  planning  period: 

SUPP Y ( I ) = ( STUD ( 1 ) ) ( SUPPLY ) . 
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7.  Miscellaneous 

UDACST(I)  Total  nondi scounted  costs  for  each  year 
In  planning  period: 

UDACST( I )aFC0ST(I )+TAEQC( I )+AIMMC( I ) 
+CINSTR( I }+SUPPY ( I ) 

+SSALRY ( I )+TRAVEL . 

H4  Total  nondi scounted  cost  of  alternative: 


H4=  £ UDACST ( I ) +FAC0ST + EAQC I +AC IMD 

lm]  H 

- RVAS/(1+DRATE)N. 

RVAS  Remaining  value  of  equipment  and  Instructional 

material  at  end  of  planning  period: 

RVAS=RVEQ+RVIM+RVFA 

PVALUE  Present  value  (cost)  of  alternative: 

N 

PVALUE*  22  ( ( UCACST ( I ) ( 2+DRATE ) ) A 
Is! 

{ 2 ( 1 +DRATE ) 1 )+  IfACQST+EAQCI+AC IMOl 
-pVAS/O.C+DRATErj.  J 

C3  Average  discounted  costs  per  student  position: 

C3*PVAL.UE/PSP 

CINT  Initial  system  acquisition  costs  for 

facilities,  equipment,  and  instructional 
material  development: 

CINT=FACOST+EQACI+ACIMD. 

ANCSP  Average  annual  nondi scounted  costs 

per  student  position. 

ANCSP*H4/(N)(PSP) 

ADCSP  Average  annual  discounted  costs  per 

student  position: 

ADCSPBPVALUE/(N)(PSP) 
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Initial  system  acquisition  costs  for 
facilities,  equipment,  and  Instructional 
material  development  per  student  position! 

AC5P-CINT/PSP. 

Uniform  annual  costs: 


UAOPVALUE/  2 [( 2+DRATE )/  ( 2 ( 1 +DRATE ) 1 j] . 
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APPENDIX  C 

FORTRAN  PROGRAM  OF  COST  MODEL 

The  purpose  of  this  appendix  is  to  supply  the  necessary  information 
for  the  use  of  the  FORTRAN  IV  Cost  Model  program.  This  information 
Includes  a FORTRAN  IV  Program  Listing,  a sample  data  set  and  a sample 
run.  The  data  collection  sheets  which  define  the  program's  input  variables 
are  presented  as  attachment  1 following  this  appendix. 

The  data  are  entered  into  the  computer  using  an  "F"  format.  All 
fields  are  eight  columns  wide.  This  format  allows  the  data  to  be  easily 
keypunched  directly  from  the  data  collection  sheets.  A sample  set  of 
data  cards  is  shown  in  the  data  deck  listing  following  the  program 
listing.  Table  17  defines  the  fields  on  the  first  group  of  data  cards. 

Each  numeric  field  must  contain  a decimal  point  or  else  it  will  be 
interpreted  as  having  two  digits  to  the  right  of  the  decimal  point. 

Several  output  options  are  available  to  the  user  of  the  cost  model 
program.  The  user  may  select  all  of  the  printouts  shown  in  figures  7,  9, 
and  10,  or  he  may  choose  any  combination  thereof.  A "1"  punched  in  the 
appropriate  column  of  card  one  selects  the  desired  printout.  If  the 
user  desires  these  tables,  he  must  supply  the  appropriate  cards  to 
define  the  variable  portions  of  the  tables.  Figure  7 requires  five 
cards  per  delivery  system  media  to  define  the  righthand  side  of  the 
table.  The  user  must  provide  a card  to  define  the  top  row  of  figure  10 
as  well  as  the  cards  necessary  to  define  the  righthand  column  of  the 
table.  Each  table  can  contain  up  to  15  rows.  The  data  deck  listing 
shows  the  cards  used  to  generate  the  tables  in  this  document. 

Figure  7 always  displays  the  same  eight  output  variables.  Note 
that  the  rows  of  numbers  for  this  table  are  printed  in  the  same  sequence 
as  they  are  calculated.  Therefore,  the  row  identification  label  cards 
must  be  in  the  same  order.  Figure  10  allows  the  user  to  select  one  of 
20  output  variables  and  display  the  value  of  this  variable  for  up  to 
eight  categories  of  training,  such  as  procedure  following  or  decision 
making  computed  on  up  to  120  previous  runs.  ,A  particular  run's  position 
in  the  table  is  determined  by  the  numbers  on  the  Run  ID  card.  For 
example,  the  "2"  and  "6"  on  the  Run  ID  card  for  Example  2 specifies  that 
this  run  Is  to  occupy  row  2,  column  6 of  the  table.  The  variable  to  be 
displayed  in  figure  10  is  selected  by  punching  the  appropriate  number  on 
a title  card.  The  output  variables  are  considered  to  be  numbered  from 
1 to  20  as  they  appear  on  the  printout  shown  in  figure  9.  For  example. 
Average  Annual  Student  Input  is  variable  number  1,  while  Nondiscounted 
Cost  of  Alternative  Is  variable  number  4.  Table  18  defines  the  card 
columns  of  the  cards  used  to  generate  figure  10.  These  cards  are  the 
last  group  of  cards  shown  in  the  data  deck  listing.  The  subroutine  that 
prints  figure  10  will  continue  to  read  title  and  variable  selection 
cards  until  an  end  of  file  is  encountered. 
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TABLE  17.  CARD  AND  COLUMN  DEFINITIONS  (CAROS  1-6) 
FOR  COST  MODEL  INPUT 


Card  1 

Col  urn 

1-  «1 

Print  all  Input  and  output  variables 

Column 

2-  -2  - 

Print  table  shown  In  figure  7 

Column 

3-  *1 

Print  table  shown  In  figure  10 

Card  2 

Columns 

1-72  - 

Up  to  72  alphanumeric  characters 

Columns 

73-76  - 

Media  number 

Columns 

77-80  - 

Learning  category  number 

Card  3 

Columns 

1-80  - 

Up  to  80  alphanumeric  characters 

Card  4 

Columns 

1-8  - 

FACOSF 

ll 

9-16  - 

LOFFA 

li 

17-24  - 

SQFTIII 

II 

25-32  - 

5QFTSY 

ll 

33-40  - 

SQFTAM 

II 

41-48  - 

EQCISP 

II 

49-56  - 

L0FEQ1 

II 

57-64  - 

EQIMPC 

11 

65-72  - 

LOFEQ 

II 

73-80  - 

TSPOSD 

Card  5 

Columns 

1-8  - 

UIMD 

II 

9-16  - 

UPDATE 

II 

17-24  - 

EVIM 

II 

25-32  - 

CIMD 

II 

33-40  - 

INTSPO 

ll 

41-48  - 

SALINR 

49-56  - 

SUPPLY 

II 

57-64  - 

STUDSL 

II 

65-72  - 

STCST1 

II 

73-80  - 

STCST2 
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TABLE  17.  CARD  AND  COLUMN  DEFINITIONS  (CARDS  6-10) 
FOR  COST  MODEL  INPUT  (continued) 


Card  6 

Columns  1-8  - N 

M 9-16  - ARATE 

" 17-24  - ORATE 

M 25-32  - WSCHOP 

" 33-40  - TLENGH 

“ 41-48  - TLEGTH 

" 49-56  - RCRATE 

M 57-64  - ARCYTM 

" 65-72  - ESP 

" 73-80  - 

Card  7* 

Columns  1-8  - CPSQFT(l)  Year  1 

" 9-16  - CPSQFT(2)  Year  2 


" 73-80  - CPSQFT (10)  Year  10 

Card  8* 

Columns  1-8  - CAQSP(l)  Year  1 

" 9-16  - CAQSP(2)  Year  2 

• * • 


" 73-80  - CAQSP(IO)  Year  10 

Card  9* 

Columns  1-8  -LOFEQ(l)  Year! 

" 9-16  - L0FEQ(2)  Year  2 

• • • 


" 73-80  - LOFEQ(IO)  Year  10 

Card  10* 

Columns  1-8  -COPMT(l)  Year  1 

" 9-16  - CGPMT(2)  Year  2 


♦ • • 

" 73-80  - COPMT(IO)  Year  10 

* A separate  card  is  required  for  each  ten  values  or  fraction  thereof . 
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TABLE  17.  CARO  AND  COLUMI  DEFINITIONS  (CARDS  11-13) 
FOR  COST  MODEL  INPUT  (continued) 


Card  11* 


Columns 

1-8  - 

OHFEQ(I) 

Year  1 

M 

9-16  - 

0MFEQ(2) 

• 

Year  2 

II 

73-80  - 

• 

OMFEQ(IO) 

Year  10 

Card  12* 

Columns 

1-8  - 

GRAD(l) 

Year  1 

II 

9-16  - 

GRAD(2) 

• 

Year  2 

II 

73-80  - 

• 

GRAD(IG) 

Year  10 

Card  131 

k 

Columns 

1-8  - 

UIMDYR(V) 

Year  1 

M 

9-16  - 
♦ 

UIMDYR(2) 

Year  2 
• 

II 

• 

73-80  - 

UIMDYR(IO) 

Year  10 

* A separate  card  is  required  for  each  ten  values  or  fraction  thereof. 
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TABLE  18.  CARDS  FOR  GENERATING  FIGURE  10 


Card  1 - Column 

headings 

Columns 

1-8 

Heading  for  table  column  1 

it 

9-16 

- 

II  II 

ii  ii  2 

li 

17-24 

- 

II  ll 

" “ 3 

II 

25-32 

- 

II  II 

M "4 

11 

33-40 

- 

II  II 

ii  ii  5 

ll 

41-48 

- 

II  II 

" " 6 

II 

49-56 

- 

II  ll 

ii  ii  -j 

ll 

57-64 

II  II 

" " 8 

II 

73-74 

- 

Number  of  row 

label  cards 

Card  2 

- Row 

labels* 

Col  umns 

1-16 

Label  for  row 

1 

II 

17-32 

- 

II  II  II 

2 

*1 

33-48 

- 

II  ll  ll 

3 

II 

49-64 

- 

II  II  II 

4 

II 

65-80 

- 

li  ll  II 

5 

Card  3 

- Title  and  variable 

selection  card 

Col umns 

1-76 

Title  of  table 

M 

77-78 

- 

Variable  selection  number  (1-20)  j 

II 

79-80 

- 

The  number  of  rows  to  be  printed  | 

* A label  card  is  necessary  for  every  five  rows  or  fraction  thereof. 
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Figure  9.  Sample  Cost  Model  Output  for  Specific  Delivery  Systems  (continued) 
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Figure  9.  Sample  Cost  Model  Output  for  Specific  Delivery  Systems  (continued) 
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Figure  10.  Sample  Sumnary.  Cost  Oata  by  Category  of  Training 
and  Cost  Factor 
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INITIAL  EQUIPMENT  ACQU 1ST  ION  COST  • JF14.2) 

initial  facilities  acouistjon  cost  i;fxo.2> 
initial  1“  Pc V COST • / 7 IX/ F 10, 2 ) 

INITIAL  system  ACCUISTION  COST'/t  FOR  FiC H IT  1 ES/ EQUI P/ AN 
8X/ F J4.21 

R6MAIa-I*'G  VALUE  OF  FQUIPMFNTI/  12X/F10.2I 
REMAINING  VALUE  CF  I « i , 19X/ F 10 . 2 ) 

NO,  uF  TN<TsuCTPRS  REOUIRED*/ i3X/Fm,l) 


.2) 

.2) 

.2) 

UNIQUE  WQUR00021700 
00021750 
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A FORTRAN  IV  ( VER  S43)  SOUPCR  [ISTINGI  OTE001  PROGRAM  04/10/75 


901 

102 

903 

>04 

909 

30ft 

907 

309 

909 


724  FORMAT! t NO.  UP  PTi'ORN’1  PtiSlYinNS'JlftX^FlO.Zl 
729  FORMAT ( 1 FACILITY  "EOUIREMFnTS  IN  5Q  FT  * / 10X# F 10 . 2} 

72ft  FORMAT! ' AVE,  ANNUAL  NONOI R . COST/STUU  PQS ' #7X> F! 0 . 2 > 

727  FORMAT! • AVE,  ANWU'1.  OISCLUNTeD  COST/STUD  PUS  trFlO.2) 
724  FO*MAT  ( i ACQlllST  J I'-'N  CDST/STUO  P05  ' 1 14X/F  10.2  ) 

729  FORMAT! • AVE.  ANNUAL  NO.  OF  STUDENTS  ON  BQARDI i4X« F10.2 > 
739  FORMAT ( 1H0 ) 

73l  FORMAT! t UNIFORM  ANNUAL  CUST >t 1 ,’X* P 14, 2 J 
PNO 


PAGE  0007 


00021790 

00023990 


I 
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A FORTRAN  IV  ( V£R  S *3 ) snusc?  'ISTlNCi  0TF081  SUBROUTINE 


04/10/75 


PAGE  0008 


1 

2 C 

3 C 
A C 
3 

6 

7 

8 
9 

10 

11 

12 

13 

14 
13 
16 
17 

15 

19 

20 

21  C 

22  C 

23 

24 
23 
26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 


700 

701 

702 

703 

704 
703 

706 

707 
703 

709 

710 

711 
717 


SUBROUTINE  DTfcOBK '**•) 

THIS  SUBROUTINE  PRINTS  OUTPUT  ARRAYS 

COMMON  STUOOin/RC-STOOliTAeoeOOIfAlHMCOOIieiNSTROO^SUPPYOO) 
1,SSALRV(30)/IJDAC«T<  3«]#mO)>NUM<30)*  aOB)  30) 

W«6 

WRITE(K/700)L'/M 
WR1TE!K,710)  (NUYft ),I»L*H> 

WRITE (K>701 ) (STuUillJ I»L#M) 

WRITE  (K/712 ) (AQ»(i)»'I«L»Hl 
WRITE ( K*  702 ) (BOOST ( I ! j I »L»M ) 

WRITE  ( K/  70S  ) (TAPOf  IP#  I«l»H> 

WRITE(K<704)  (AIMMr ( I) j I«L,H) 

WRITE  (K, 705)  (CINS7R(I),l«l.,M) 
uRTTE(K,706)  (3UPPY ( T ) • I »L»M) 

WRITE  (K/707 ) (SSAL»YII)#T«I./MJ 
WR  T TE  ( K#  708  ) (T(T)'.I-L#M) 

WRITE (K/709 ) ( UOAC *T ( I ) / I *L>  M ) 

V'RTTE  <K,711  ) 

PRINTER  OUTPUT  OAT.*.  FORMAT  CODES 

FORMAT)  lHOjTBQ,  TUTP'IT  SUMMARY  YEARS ' 12* ' - ' / 12 > 

F0RMATI1H0, 1 S fUDFNT  INPUT  I » 27X* 9F 10 . 1 ) 

FORMAT ( i NONnlJCrU-TFO  ANNUAL  FAC.  COST t , 10X* 9F , f ) 

NONOlSCOJ-TFa  annual  *' 

NQNO ISC*Uk  TED  annual 
NONOlSCnuSTFO  ANNUAL 
NONOlSCMUYTEO  ANNUAL 
NONOlSCnU*'TFO  ANNUAL 
NONO I SCmunTFO  ANNUAL 
NONOlSCflU’TEQ  ANNUAL 


OU021940 

00021930 

00021960. 

00001500 


00023’ OO 


00025400 

00025500 

00025700 

00025600 

OQ025900 


FDR  "i AT  ( l 
FQRMAT { ' 
FORMAT ( ' 

format ( ' 

FORMAT ( * 
FORMAT) • 

FD»M AT ( ' 
FORMAT)  i 
FORMAT) 1H0) 
FO»NAT('  AVE. 
RETURN 

ENn 


FOUIPMEnT  COST  tf4x*9F10.1> 
IM  CnST I 12X/ 9F 1& . I ) 

INSTR.  COST  I/7R.9FP.1 ) 
SUPPLY  COST  i /7Xi 9F ln  . 1 ) 

student  salaries  i;9Fi<j,i> 

TRAVEL  COSTI/BX,9fVo'.1) 
OPERATION  eOST'5X,9F10.1) 


YEARIj4JX. I ? * 0 l 3 X * 12) ) 


nq;  "F  STUDENTS  ON  BnARD'*llX*9FlO*.  l) 


00024950 
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A FPRTfl  4KI  IV  O'FIR  SAT)  SOUSCE  i'I«T!Nr.l  0TE0A1  SUPROUT  INE  OA/10/75  PAGE  0009 

l TJnROUTlflE  OTfAl  (Lj'OMU'UI 

? r, 

3 r ?'.I"FU'JTIIIE  TO  PRINT  INPUT  A RRAVS 

A c 

5 f'I"ENS  [O'l  NU‘<U1«) 

6 fl.tiN'O'l/INVAR/k®  API  70  OCPTgFT  ( .30)  ,C0Pnt<  30)*C4QSP(3n  )/UlHOYR(  301  #0M 

7 lFFn{  30)/RI,OFeQI30) 

f)  v af, 

9 wp  tTE(K»1Q)  liR'MM  I >;  I«L<P>J 

10  wRlTE(IOll)  (liFAOt  O#  1«L>K* 

11  '••'R I T6  ( K>  12)  (CPS0PT(f  )j 

U ‘■'P.tTE(K>  13)  fnPMTf 

13  •■'RrrtIK/17)  ) U!'FPQ  ( 1 1 < ! *li  f‘ ) 

1A  MRITctK/lA)  ICAQTP'f  I)j  l«UH) 

15  V RITEIK, 1«)  I R 1 Q F E o ( I ), I - L » H » 

16  VRITE(K,15)  (UfMOYP ( I ), 1-LjM) 

17  WRITE  (10  161 

1«  RETURN 

19  IT  FIJP'-'AT  ( • YKAPl#A»X,l?>«(AX»I?)l 

20  11  F0t;:aT(  lo&RATUATcS  RF00./yEAPO29X»9Fl0,l) 

21  12  FQPKATC  C r J S T / ? U F'  . • , 290 9F  10 . 2 ) 

22  17  FQMATP  OP  F 0 AT  ion  A^O  M«INT.  f.OST/YR,  O 11Xj9F10'.2) 

23  1 A FQ0I-1AT  ( * A'lM'lAL  ACOUlSTinN  CHST/STUD.  PQSO  PX/9Rlo,2> 

2A  IT  FQPMATC  UNI9UF  WQI'RT  OF  l*0/YR O 1RX,9F10. 1 > 

25  16  F[jp;<AT(  1H0) 

26  17  F.CIP3AT ( ' 0€M  COST  "F  FIXcO  EfHJtP«ENT 13X,9F  10 .2 1 

27  IT  FOPI'ATII  EXPFCTEP  l.'tEE  QF  CAQSP(t)  ASSETS  I > SX*  9F  io*.  1 ) 

2“  FNO 


107 


I 


TAEG  Report  No.  16 


A FJ«T**v  I V (vtR  S43)  S"U»CE  LHTINf.1  0TE0C1  SUBRDllTINg 


04/10/75 


PACE  0010 


1 

2 C 

1 c 
<•  c 

5 5 

6 C 

7 
B 

9 C 
n c 
n c 
u 

13 

14 

15  C 
15  C 
17  C 
IB 
1° 

2n 

21 

22 

23 

24 
23 
26 
27 
23 

29 

30 

31 

32 

33 

34 

35 

36 

3 7 
3F 
39 
43 

41 

42 

43 

44 

45 

46 

47 
45 
49 


«U4« Jl'Tir.E  DTeOCl(»C7) 

1‘flr.niENT  1 - KIT  - NO.  QF  RUNS 

this  subroutine  prints  a summary  table 

•MANSION  LABfeL(T5.7i 
COHKON  /TABL */  T0ATA(15#b) 

INITIALIZE  S'JBpQUTJNR  VflO  1 ARLES 

ISTART-1 
I £nD»4 
IHFAD-1 

•UILO  LABEL  TARLR 

T S - 1 
1HALT»5 

2 no  9 WS/1H4LT 

O «Ef C (3, m>Enn»3)  (I AR£L!I/J)/J>l/7) 

I S * 1 S + 5 
I HA  LT“ I HALT  + 5 
r-o  TO  2 

* IFdHEAD.NE.il  UP  TQ  4 
WRITE  I 6, 15) 

KR I TE ( 6/ 19 ) 

WR ITE ( 6/ 11 ) 
v P T TE  < to# 12  i 
WRTTEI6/13) 

WRITE! 6/ 14 ) 

VRITE<6,19) 

IHead»2 
nr  TG  3 

V TFfKCT.GT.J)  W»j4El6;i5) 
vR I TE ( 6/ 19 ) 

WRITE! 6/ 16) 

'■'RITE  (6#  17) 

WRITE  16/ 16) 
v R I TE ! 6/ 19 ) 

1 HF  AD“ 3 
« ISd 
I H&L  T“ 5 

n0  50  Kl«l,KfT 
•RITE (6/ 20) 

"P  6 11*15, ImALT 
I F f I1.NE.IS42)  &n  to  7 

'■'RITE  (e/21)  (LABEL!  11/ j )/J«  1,71/  (TOATA(Kl/J),J«iSTART/IEND! 

00  TD  t 

7 u'R  lT6<6/22)  (UABFLf  M/JI/J-1/7) 


) 
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A FORTRAN  IV  (VER  S43)  Sr.U*CE  CUTlNCl  DTF0C1  SUBROUTINE 


04/10/75 


Pi 


o 

o 

o 


! I 

•k  . - 


51  A CONTINUE 

32  WRITE ( 6,  20 ) 

33  WRITE! 6/ 19  ) 

34  IS-IS+5 

33  IH*LT*IHALT*9 

36  30  CONTINUE 

37  I F f IHEAD.E0.3)  RFT'lRN 

31  1START»5 

39  IEM0»* 

60  00  TO  3 

61  10  FORMAT (7A4 ) 

67  l\  FORMAT ( i 4I/t32,I4'jT42, 'PRESENT', T57, »4  AVERAGE  DISCOUNTED  *1 

63  1,T91, 'UNlF0RMl,Tl07, 14  ACOU1STION  COST  4tj 

64  17  FORMAT ( I *1/732# l+t#T43* 'CD5T«;T57, '•  COST  pFR  GRADUATE  4i,TB 

63  19, 1 ANNUAL  COST ' , U*i7,  i 4 FUR  FACILITIES  jEOUIR,  41) 

66  13  FORMAT  ( ' 41  ,T37,  I 4 I , T57,  "* ' , T82,  «*  T 107,  ' * ANO  ' nSTRUCT lONAf 

67  1 4* ) 

65  14  FORMAT ( I 4 l , T32,l * l , T57, • * » ,T82> * * • > T 107* • * MaTE»I3|.  OEVElOPEMFNT 

69  1 4i ) 

70  15  FORMAT ( 1 H 1 ) 

71  1ft  FOR  MAT ( 1 4t,T32,'4 i, T4?» 'NO,  OF • , T57,  I * ' , ' NO^-OI SCOUNTED 

72  14  NO.  OF  ITl'DFNT  4 AVERAGE  HOURS  PFR  4i» 

73  17  FORMAT  ( ' 4 < , t32,  ' * ' , T3*1,  ' INSTRUCTQRS',T57,  '*  ANNUAL  INSTRUCTOR 

74  1 4 POSITIONS  RFOi.'IREO  4 GRADUATE  IN  MODULE  *') 

73  1R  FOR  MAT ( ' 4I,T3?,T4>IN  MAN..YEARS  PER  YEAR)  4 ( , f677 I COST ' , T82, 1 4 i , T1 

76  107, '*',1132, •* 1 > 

77  In  fouMATIIH  ,32(1*444'), '444' ) 

78  20  FO*MAT ( 1 4!,t32, l*',T37, '4',TB2> '4',T107, I4',T137, '4' ) 

79.  21  FORMATdH  , 7A4,  ' 4i,«,(5Y#F14,},-)X,t4in 

80  2?  F0RMAT(1H  ,7A4, l 4'i4I24X, 141 I) 

81  FHO 


1 ) 


0011 


109 
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A FORTRAN  IV  (VgR  S43)  S0U«CF  C 1 « T X N C | nTFOOl  SUBRQUTINg 
5 U® POUT  I NS  DTfci'Dl  ( "S  A/  Lc  > 

THIS  SUBROUTINE  ST?ReS  OUTPUT  TABLE  VALUES 


0*/ 10/73 


PACE  0012 


1 

2 C 

3 C 
* C 

5 

6 
7 
e 
9 

10 


COMMON  /0VAR/C0ATAV2O) 
COHMON/TVAR/  X<H>*i20) 
00  1 1-1/20 
i x(Neonc/n«coAT6< n 

RETURN 

END 


'vJ 


u 


v, 


) ! 


) ■ 


) ■ 


J i 


) ■ 


) ? 
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A FORTRAN  TV  (U£R  5431  SOURCg  LISTING* 


04/10/73 


FARE  0013 


SUBROUTINE  DT6->e  1 

THIS  SUBRQUT ttHF  PRINTS  A TABLE 

COMMON  /TVAR/  X(13,B,2P1 

DIMENSION  IV«RUo);ICAT<16!/NE0!AU5*4) 

REAP  CATEGORY  HESDfN«S  ANC  NO,  OF  MEDIA  CARDS 

®E  AP  < 5/ 16 ) (ICATf Ii#T»l,16),NCT 
rST«i 
T EMC.  *5 

icr«0 

7 R E AD  ( 5/  17}  < (MPOtA' l»J>*  J"1*A)»  J«IST#  JEND> 

TCT« ICT+1 

IE(ICT,EO.NCr)  C.M  YQ! 

TST«IST+5 
t6nC»IEND*3 
GO  TO  3 

P F Ap  TABLE  VARIABLE  AND  NO.  OF  MEDIA  TO  BE  PR I*'TFD 

1 PE*f't5/10/ENO»JOP>  nVARU)/I*lil9}/NVARjNMEP 
NRTTE<6*  11}  ( 1 VAR  ( T >,‘l«l,  19) 
mr  i TE ( 6/ 12 ) 

WR  ? TE ( 6, 13 ) 

WR ITE ( 6, 14 ) < ICAY{ T }# l«l» 14) 

T TE  { 6,  13  ) 

'••R  T TE ( 6> 12 ) 
nrj  z K«1#NMEP 
WRITE (fe# 13) 

WATTE <6, 15)  (MEDIAfK,^), J»l,A}  > <XIK/LC/NVAR)#LC»1/P) 
WR  T TE  c 6> 13 ) 

7 WRTTE(6,1Z) 

GO  TO  1 

10*  RETURN 
}n  FUeHAT(19A4,7l?) 

11  *PnKAT(lHl,l<>A4>//1 
17  *07 MAT ( IH  ,31 ( ), »*I ) 

1?  FORMAT ( ' *t,r22,l*l,R(12X,'*i)) 

1 A *0®KAT ( > *«,T2?,l*i,P<ZX#2A4,2X,'*')) 

1*!  *08F  AT  ( * *',?X»AAA;i  *»,R«lX,Fi0.li'  *'>) 

16  ROet'ATdftAA/RX*!?) 

17  *no|'A(T<20AA) 

*Nn 


S' 


y 

L 


! 

f 


f 

\ 
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IX 1 

*4*  D*TA 

PECK  LISTING  *•* 

RUN  ID 

1 Eya» 

PI  F 1 

1 

1 

INSTRUCTIONAL 

DELIVERY 

SYSTEM  - 

“iPERATrCMAL  SYSTEM  III 

A LAnO»HTQ»Y  |»i I TU 

TUYOP 

0. 

C. 

64. 

75, 

loO. 

0. 

O'. 

3060. 

10. 

.01 

1.0 

'■.20 

0. 

'0, 

1.6 

16240. 

0. 

1114’. 

0. 

6, 

10. 

r,04 

0,10 

«Y, 

",1 

*. 

<i. 

0. 

0 .05 

2.73 

2. 75 

2.75 

7.75 

7,75 

7.75 

2.T5 

7.75 

2.75 

7.75 

0. 

0. 

.0. 

0. 

". 

6, 

c. 

0. 

6. 

0. 

0. 

p. 

0. 

r. 

6, 

0. 

6. 

6. 

C. 

190. 

15". 

150. 

15“, 

156. 

157. 

ISC. 

19". 

15'-., 

157. 

0. 

0. 

0, 

7. 

6. 

0. 

6, 

6. 

6. 

1300. 

Uno. 

13u0. 

1 2r0, 

’260. 

1 1"0. 

1100. 

1 160'. 

HOC. 

11*0. 

0. 

0. 

0, 

• 

. « 

6. 

t- 

••  • 

6. 

p. 

HUN  ID 

» EXA"PI  C 2 

2 

6 

INSTRUCT  I QA'Al 

'’EL  I V£RY 

SYSTEM  . 

"ICR? 

f T S ME  WITH 

PHTTI'i 

MOCKUP 

0. 

0. 

64. 

75. 

1 uO. 

6, 

• 

275. 

10. 

.0’ 

1. 

.2'' 

0. 

1134'. 

.1 

16240. 

c. 

11141. 

0. 

0. 

10. 

.('A 

• If 

Rt. 

.1 

4. 

.35 

.1 

.05 

2. T9 

2.75 

7.75 

». 7b 

7.75 

7.75 

7.75 

2.75 

7,75 

0. 

6. 

0. 

6. 

‘ • 

r\ 

» 

6. 

6. 

0. 

0. 

n. 

* 

6. 

!'•. 

0. 

7. 

19. 

15. 

15. 

17. 

•’5'. 

15. 

15. 

15. 

15. 

1 5’. 

0. 

^ • 

0. 

A. 

o. 

6, 

6. 

6. 

1300. 

1460, 

1300. 

*260. 

1 1"0. 

1160. 

116Q'. 

line. 

ll“0. 

0. 

6. 

0. 

D. 

6, 

6. 

6. 

END  OF 

FILR  INDICATOR 

* 

* 

SvSTE'i  A 

* QPEKATJL'NAl 

"SYSTEM  In 

A 

• LARUBATCRY 

* 

U I TM  TUTOR 

* 

* 

system  e 

* MICROFISHf 

’«■  I T H PmUTC 

* MnCKUB 

* 

END  OF 

FILE  INDICATOR 

CAT  1 

CAT 

2 CAT  3 

CAT  4 

CAT 

5 CAT  6 

CAT  7 

C*T  * 

1 

UP. 

SYSTEV 

HICRDFl'HC 

C A I 

PT 

L INC  A* 

PT  BPAA'C^InO 

nqnd i sc  quoted 

ACST  PER 

liBADUATc 

- EXAr®LF  } 

6 

3 

NONDISCUUliTEn 

COST  OF  ALTtFN.*TTVc 

4 

3 

INITIAL 

lURTBUi-Tr.'fiAL  MATERIAL 

Obvfl°PFmbnT  COST 

10 

3 

END  DF 

F T Le  INDICATOR 

ENO  OF  F!l.c  INDICATOR 

****  end  OF  l’ST  **** 


) H 

i ; 


) 


j 


i 


i 


3 


«*  STn? 


i 
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COST  DATA  COLLECTION  FORM 


Instructional  Delivery  System_ 
Run  ID 


n 


ymbol 

Variable  Description 

Value 

Units 

SQFTIN 


Total  facilities  acquisition 
and/or  refurbishing  costs 


xpected  years  of  life  of 
FACOST  assets  (in  whole  numb 


Total  square  feet  require 
for  each  instructor 


Total  square  feet  required 
for  administrative  overhead 
for  all  student  positions 


Dollars 


Years 


Sq  ft 


S 


Sq  ft 


EqciSP 

Equip.  Implementation  costs 
Independent  of  stud.  pos. 

L0FEQ1 

Expected  years  of  life  of 
EQCISP  assets 

Fquip.  Implementation  costs 
per  student  position 

LOFEQ 

Expected  years  of  life  of 
EQIMPC  assets  (In  whole  numbers) 

TSPOSD 

Percent  of  operating  time 
student  position  down 

Dollars 


Years 


Dollars 


Years 


Percent 


.11., ...  HlauUlUnttmiiai iiiutUaUM-i 


I 
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Variable  Description 


l mum 


snuai 


iscellaneous 


X of  TLENGH  (i.e. , time  spent 
In  training  medum)  for  which 
new  Instructional  material 
must  be  developed 


X of  original  development  cost 
required  each  year  to  maintain 
instructional  material 


verage  cost  of  developing 
one  hour  of  Instructional 
material 


Instructor  to  student 
sltlon  ratio 


Cost  of  expendable  supplies  for 
each  student  while  enrolled  In 
course 


Annual  salary  and  benefits  of 
one  student 


Average  student  travel  cost 
to  and  from  school 


Average  per  student  travel  cost 
as  a part  of  course 


Value 


Number  of  years  In  plannln 


ttntlon  rate 


scount  rate 


Weeks  school  operates  each  year 


verage  time  spent  In  training 
medium  per  student 
(non-recycled  students 


verage  hours  per  week  student 
nds  In  medium 


ecvcle  rate 


Average  time  the  recycled  student 
spends  repeating  material 


Percentage  of  excess  student 
positions  required  to  provide 
for  fluctuations  in  input 


Units 


Percent 


Percent 


Percent 


Dollars 


Decimal 

Rat’c 


Dollars 


Dollars 


Dollars 


Years 


ercent 


ercent 


eks 


Percent 


percent  values  are  entered  as  decimal  equivalents. 
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